00000001:02000400:1.0F:1788796359.820358:0:2960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788796380.677537:0:3181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1788796383.049449:0:3241:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 579 MB/s 00000001:01000000:3.0F:1788796383.299148:0:3241:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 863 MB/s 00000001:01000000:2.0F:1788796383.548837:0:3241:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3543 MB/s 00000020:02000000:1.0:1788796384.745835:0:3273:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g569731d 00000400:02000000:0.0:1788796386.391341:0:3288:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.125@tcp [8/256/0/180] 00008000:02000000:3.0:1788796390.192724:0:3437:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788796442.204187:0:5244:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788796459.271066:0:5822:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788796459.271073:0:5822:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788796459.271209:0:5822:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000042f868bc 00000080:02000400:2.0:1788796459.271220:0:5822:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788796459.283052:0:5822:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788796459.283066:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788796459.283107:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000032b5c43b) 00000020:00000080:2.0:1788796459.283127:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788796459.310376:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788796459.310734:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788796459.335624:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788796459.335662:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788796459.335682:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788796459.335726:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788796459.335775:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788796459.336314:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788796459.336321:0:5822:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788796459.336332:0:5822:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd273c88cfe22318 00000020:01000004:3.0:1788796459.336339:0:5822:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788796459.336343:0:5822:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788796459.336347:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000042f868bc from MGS 00000020:01000004:3.0:1788796459.336352:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788796459.336368:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000453435a9) 00000020:00000080:3.0:1788796459.336379:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788796459.336496:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000042f868bc from MGS, refs=2 00080000:01000000:3.0:1788796459.336502:0:5822:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788796459.336507:0:5822:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd273c88cfe22326 00000100:00100000:3.0:1788796459.336599:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788796459.336742:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788796459.336788:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788796459.337865:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788796459.337874:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788796459.339471:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788796459.339638:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788796459.339644:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788796459.340513:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788796459.340520:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788796459.341836:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788796459.341844:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788796459.342700:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796459.342704:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796459.342705:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796459.343100:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796459.343102:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796459.343103:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796459.344413:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788796459.351798:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788796459.597591:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2976 MB/s 00000001:01000000:3.0:1788796459.846881:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3187 MB/s 00000001:01000000:0.0:1788796460.099139:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 432 MB/s 00000001:01000000:3.0:1788796460.353810:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 412 MB/s 00010000:00010000:0.0:1788796460.377900:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1788796460.401558:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1788796460.449109:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788796460.449128:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788796460.449132:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788796460.473797:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788796460.473890:0:5822:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788796460.473950:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788796460.474441:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788796460.474472:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788796460.474884:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788796460.475050:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788796460.475057:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788796460.485444:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788796460.485461:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788796460.486208:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788796460.486217:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788796460.510807:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788796460.510836:0:5822:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.125@tcp' 00000020:01000004:2.0:1788796460.510838:0:5822:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788796460.510886:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.125@tcp (typ=mgc) 00000020:00000080:2.0:1788796460.510918:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.125@tcp (00000000c0c2e7ab) 00000020:00000080:2.0:1788796460.510933:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788796460.511011:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000026bfc9fe@MGC192.168.201.125@tcp: add connection 192.168.201.125@tcp at head 00010000:00010000:2.0:1788796460.511171:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.125@tcp-0 is initialized 00000040:01000000:2.0:1788796460.511177:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788796460.513621:0:5840:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788796460.516109:0:5841:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788796460.516210:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.125@tcp (uuid 7f7145a2-0840-45a5-acde-da959fc7802f) 00000020:00000080:1.0:1788796460.516233:0:5822:0:(genops.c:1384:class_connect()) connect: client 7f7145a2-0840-45a5-acde-da959fc7802f, cookie 0xdd273c88cfe22334 00000100:00080000:1.0:1788796460.516244:0:5822:0:(import.c:545:import_select_connection()) MGC192.168.201.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788796460.516256:0:5822:0:(import.c:666:import_select_connection()) MGC192.168.201.125@tcp: import 0000000026bfc9fe using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1788796460.516306:0:5822:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f0e5ad72 x1875688959246464/t0(0) o250->MGC192.168.201.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788796460.516429:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f0e5ad72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7f7145a2-0840-45a5-acde-da959fc7802f:3303:1875688959246464:0@lo:250: 00000100:00100000:3.0:1788796460.516550:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788796460.516667:0:5822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7f7145a2-0840-45a5-acde-da959fc7802f->MGS 00000020:01000004:1.0:1788796460.516687:0:5822:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788796460.516693:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788796460.516712:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000da499f3e) 00000020:00000080:1.0:1788796460.516726:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788796460.519084:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959246464 00000100:00100000:2.0:1788796460.519101:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959246464 00000100:00100000:2.0:1788796460.519138:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788796460.519144:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000074bfb699 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1875688959246464:12345-0@lo:250: 00010000:00080000:2.0:1788796460.519170:0:5837:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7f7145a2-0840-45a5-acde-da959fc7802f@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:2.0:1788796460.519197:0:5837:0:(genops.c:1384:class_connect()) connect: client 7f7145a2-0840-45a5-acde-da959fc7802f, cookie 0xdd273c88cfe22342 00000100:00080000:2.0:1788796460.519339:0:5837:0:(import.c:65:import_set_state_nolock()) 000000009b91ede8 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788796460.539573:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000074bfb699 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+5:3303:x1875688959246464:12345-0@lo:250: Request processed in 20420us (23015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796460.539590:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796460.543868:0:3303:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788796460.543890:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.125@tcp: connect to target with instance 0 00000100:00080000:3.0:1788796460.543900:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788796460.543906:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788796460.543910:0:3303:0:(import.c:65:import_set_state_nolock()) 0000000026bfc9fe MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788796460.543914:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788796460.544983:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788796460.544997:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f0e5ad72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7f7145a2-0840-45a5-acde-da959fc7802f:3303:1875688959246464:0@lo:250: 00000100:00100000:1.0:1788796460.564409:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788796460.565030:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788796460.565038:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788796460.579259:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788796460.579280:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788796460.580189:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788796460.580198:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788796460.581024:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788796460.581220:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788796460.581226:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788796460.582000:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788796460.582008:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788796460.648263:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788796460.648654:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788796460.648660:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788796460.653456:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788796460.653475:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788796460.654272:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788796460.654485:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788796460.654489:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788796460.656478:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788796460.656502:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788796460.657266:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788796460.657482:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788796460.657488:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788796460.658017:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788796460.658025:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788796460.658578:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788796460.658725:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788796460.658730:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788796460.659298:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788796460.659305:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788796460.689886:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788796460.690106:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788796460.690112:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788796460.692066:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788796460.692080:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788796460.692993:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788796460.693001:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788796460.694521:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788796460.694543:0:5822:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788796460.694549:0:5822:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788796460.694673:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788796460.694707:0:5822:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.125@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788796460.694712:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788796460.694714:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788796460.694715:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796460.694717:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796460.694718:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796460.694720:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796460.694722:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788796460.694723:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788796460.694725:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788796460.694726:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788796460.694727:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796460.694729:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788796460.694731:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788796460.694737:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788796460.694738:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788796460.694740:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796460.694741:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796460.694742:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796460.694743:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796460.694849:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788796460.694850:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788796460.694851:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788796460.694852:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788796460.694853:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796460.694854:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788796460.694890:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788796460.694907:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008d1b2399 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959246592:0@lo:253: 00000100:00100000:2.0:1788796460.694984:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796460.695077:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000023536cc1 going to sleep for 11 seconds 00000100:00100000:3.0:1788796460.695144:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959246592 00000100:00100000:3.0:1788796460.695152:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959246592 00000100:00100000:3.0:1788796460.695191:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788796460.695199:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c2167bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+5:5822:x1875688959246592:12345-0@lo:253: 20000000:01000000:3.0:1788796460.695252:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788796460.695256:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788796460.695696:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788796460.696058:0:5839:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788796460.696315:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788796460.697238:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788796460.697592:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788796460.697596:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788796460.697602:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788796460.697605:0:5839:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788796460.697620:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788796460.697939:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788796460.698173:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788796460.698186:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788796460.698238:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788796460.698288:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788796460.698326:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788796460.698725:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788796460.698735:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788796460.699081:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788796460.699090:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788796460.699122:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788796460.699129:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788796460.699169:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788796460.699214:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788796460.699248:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788796460.699253:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788796460.699267:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788796460.699545:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788796460.699556:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788796460.699590:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788796460.699624:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788796460.699668:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788796460.699679:0:5839:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788796460.699890:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788796460.699900:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788796460.699950:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788796460.700005:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788796460.700041:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788796460.700052:0:5839:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788796460.700137:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788796460.700146:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788796460.700176:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788796460.700210:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788796460.700366:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788796460.700522:0:5839:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788796460.700530:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788796460.701279:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788796460.701710:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788796460.701730:0:5839:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.125@tcp for mdt 20000000:01000000:2.0:1788796460.701732:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.125@tcp (null) (null) (null) 00000040:00080000:2.0:1788796460.702777:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788796460.702791:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788796460.702822:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788796460.702828:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.125@tcp (null) (null) 00000040:00080000:2.0:1788796460.702892:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788796460.702909:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788796460.702942:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788796460.702976:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788796460.703069:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788796460.703072:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788796460.703077:0:5839:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788796460.703084:0:5839:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788796460.703968:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1788796460.704284:0:5839:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788796460.728177:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788796460.728229:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1788796460.728317:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1788796460.728336:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788796460.728339:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788796460.728342:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788796460.728356:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788796460.728358:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788796460.728395:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788796460.728398:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788796460.729102:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1788796460.729359:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1788796460.729418:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1788796460.729480:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1788796460.729503:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788796460.729505:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788796460.729914:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788796460.730215:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788796460.730256:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788796460.730294:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1788796460.730307:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788796460.730309:0:5839:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1788796460.730316:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788796460.730335:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003d83bd20/0xdd273c88cfe22349 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.730351:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d83bd20/0xdd273c88cfe22349 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.730359:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003d83bd20/0xdd273c88cfe22349 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.730365:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003d83bd20/0xdd273c88cfe22349 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.730370:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003d83bd20/0xdd273c88cfe22349 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.730387:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003d83bd20/0xdd273c88cfe22349 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.730393:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003d83bd20 already unused, calling callback (000000008be5c8d8) 00010000:00010000:1.0:1788796460.730396:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003d83bd20/0xdd273c88cfe22349 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.730403:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003d83bd20/0xdd273c88cfe22349 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.730427:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003d83bd20/0xdd273c88cfe22349 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.730433:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003d83bd20/0xdd273c88cfe22349 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.730438:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003d83bd20/0xdd273c88cfe22349 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788796460.730452:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788796460.985320:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c2167bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+5:5822:x1875688959246592:12345-0@lo:253: Request processed in 290116us (290330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796460.985340:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796460.985467:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008d1b2399 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959246592:0@lo:253: 10000000:01000000:0.0:1788796460.985484:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788796460.985487:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788796460.985489:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788796460.985490:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788796460.985491:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788796460.985492:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788796460.985494:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788796460.985495:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788796460.985497:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788796460.985504:0:5822:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788796460.985506:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788796460.985507:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788796460.985525:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000042f868bc from lustre-MDT0000 10000000:01000000:0.0:1788796460.985564:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788796460.985566:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788796460.985570:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bd26caa3370 10000000:01000000:0.0:1788796460.985575:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788796460.985583:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd26caa3370 from 1 10000000:01000000:0.0:1788796460.985586:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788796460.985631:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 000000008387b6c5/0xdd273c88cfe22350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796460.985641:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 000000008387b6c5/0xdd273c88cfe22350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796460.985650:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 000000008387b6c5/0xdd273c88cfe22350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796460.985667:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e94886d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959246720:0@lo:101: 00000100:00100000:0.0:1788796460.985699:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796460.985769:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000009dadb725 going to sleep for 11 seconds 00000100:00100000:1.0:1788796460.986216:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959246720 00000100:00100000:1.0:1788796460.986224:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959246720 00000100:00100000:1.0:1788796460.986264:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788796460.986271:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7fd3ebf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+5:5822:x1875688959246720:12345-0@lo:101: 00010000:00010000:1.0:1788796460.986283:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796460.986295:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003d83bd20/0xdd273c88cfe22357 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe22350 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.986317:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d83bd20/0xdd273c88cfe22357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe22350 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.986327:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003d83bd20/0xdd273c88cfe22357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22350 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.986335:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003d83bd20, rc 0) 00000100:00100000:1.0:1788796460.986389:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7fd3ebf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+6:5822:x1875688959246720:12345-0@lo:101: Request processed in 118us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796460.986400:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788796460.986645:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e94886d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959246720:0@lo:101: 00010000:00010000:0.0:1788796460.986658:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 000000008387b6c5/0xdd273c88cfe22350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796460.986666:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 000000008387b6c5/0xdd273c88cfe22350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796460.986709:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e94886d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959246848:0@lo:501: 00000100:00100000:0.0:1788796460.986733:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796460.986794:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000009dadb725 going to sleep for 11 seconds 00000100:00100000:1.0:1788796460.986875:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959246848 00000100:00100000:1.0:1788796460.986881:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959246848 00000100:00100000:1.0:1788796460.986910:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788796460.986916:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000088b92a93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+6:5822:x1875688959246848:12345-0@lo:501: 00000100:00100000:1.0:1788796460.987133:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000088b92a93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+6:5822:x1875688959246848:12345-0@lo:501: Request processed in 216us (398us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788796460.987140:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788796460.987292:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e94886d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959246848:0@lo:501: 10000000:01000000:0.0:1788796460.987313:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788796460.987328:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 000000008387b6c5/0xdd273c88cfe22350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796460.987336:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 000000008387b6c5/0xdd273c88cfe22350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796460.987343:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd250afa000 10000000:01000000:0.0:1788796460.987347:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788796460.987350:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bd250afa000 10000000:01000000:0.0:1788796460.987353:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788796460.987355:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bd250afa000 from 1 10000000:01000000:0.0:1788796460.987357:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788796460.987382:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000a4d42cd5/0xdd273c88cfe2235e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796460.987389:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000a4d42cd5/0xdd273c88cfe2235e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796460.987396:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000a4d42cd5/0xdd273c88cfe2235e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796460.987407:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e94886d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959246976:0@lo:101: 00000100:00100000:0.0:1788796460.987431:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796460.987551:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000009dadb725 going to sleep for 11 seconds 00000100:00100000:1.0:1788796460.987604:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959246976 00000100:00100000:1.0:1788796460.987609:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959246976 00000100:00100000:1.0:1788796460.987637:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788796460.987643:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000037722b0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+6:5822:x1875688959246976:12345-0@lo:101: 00010000:00010000:1.0:1788796460.987651:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796460.987671:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000398ab38f/0xdd273c88cfe22365 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2235e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.987685:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000398ab38f/0xdd273c88cfe22365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2235e expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.987693:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000398ab38f/0xdd273c88cfe22365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2235e expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796460.987699:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000398ab38f, rc 0) 00000100:00100000:1.0:1788796460.987726:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000037722b0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+7:5822:x1875688959246976:12345-0@lo:101: Request processed in 84us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796460.987731:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788796460.993054:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e94886d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959246976:0@lo:101: 00010000:00010000:0.0:1788796460.993081:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000a4d42cd5/0xdd273c88cfe2235e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796460.993111:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000a4d42cd5/0xdd273c88cfe2235e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796460.993129:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788796460.993146:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 00000000a4d42cd5/0xdd273c88cfe2235e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796460.993153:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 00000000a4d42cd5/0xdd273c88cfe2235e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796460.993161:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788796460.993166:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788796460.993171:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bd250afa000 10000000:01000000:0.0:1788796460.993175:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788796460.993178:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788796460.993181:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788796460.993219:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000aaab94c3/0xdd273c88cfe2236c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796460.993226:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000aaab94c3/0xdd273c88cfe2236c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796460.993234:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000aaab94c3/0xdd273c88cfe2236c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796460.993529:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e94886d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959247104:0@lo:101: 00000100:00100000:0.0:1788796460.993591:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796460.993636:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000009dadb725 going to sleep for 11 seconds 00000100:00100000:2.0:1788796460.993882:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959247104 00000100:00100000:2.0:1788796460.993891:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959247104 00000100:00100000:2.0:1788796460.993941:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788796460.993951:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c366da1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+7:5822:x1875688959247104:12345-0@lo:101: 00010000:00010000:2.0:1788796460.993965:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796460.993978:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b08076cb/0xdd273c88cfe22373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2236c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796460.993996:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b08076cb/0xdd273c88cfe22373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2236c expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796460.994004:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b08076cb/0xdd273c88cfe22373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2236c expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796460.994012:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b08076cb, rc 0) 00000100:00100000:2.0:1788796460.994054:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c366da1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+8:5822:x1875688959247104:12345-0@lo:101: Request processed in 105us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796460.994061:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788796460.994229:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e94886d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959247104:0@lo:101: 00010000:00010000:0.0:1788796460.994645:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000aaab94c3/0xdd273c88cfe2236c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22373 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796460.994655:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000aaab94c3/0xdd273c88cfe2236c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22373 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796460.994727:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e94886d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959247232:0@lo:501: 00000100:00100000:0.0:1788796460.995065:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796460.995103:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000009dadb725 going to sleep for 11 seconds 00000100:00100000:1.0:1788796460.995177:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959247232 00000100:00100000:1.0:1788796460.995183:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959247232 00000100:00100000:1.0:1788796460.995229:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788796460.995236:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000044204c9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+8:5822:x1875688959247232:12345-0@lo:501: 00000100:00100000:1.0:1788796460.995642:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000044204c9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+9:5822:x1875688959247232:12345-0@lo:501: Request processed in 407us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796460.995650:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788796460.995901:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e94886d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959247232:0@lo:501: 00000100:00100000:0.0:1788796460.995934:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e94886d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959247360:0@lo:503: 00000100:00100000:0.0:1788796460.995972:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796460.996002:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000009dadb725 going to sleep for 11 seconds 00000100:00100000:1.0:1788796460.996057:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959247360 00000100:00100000:1.0:1788796460.996062:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959247360 00000100:00100000:1.0:1788796460.996094:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788796460.996100:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000268d3e1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+9:5822:x1875688959247360:12345-0@lo:503: 00000100:00100000:1.0:1788796460.996596:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000268d3e1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+9:5822:x1875688959247360:12345-0@lo:503: Request processed in 497us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796460.996604:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788796460.996742:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e94886d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959247360:0@lo:503: 00000100:00100000:3.0:1788796460.997196:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f11b9ba3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:5867:1875688959247488:0@lo:502: 00000100:00100000:3.0:1788796460.997432:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796460.997559:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d32e151 going to sleep for 11 seconds 00000100:00100000:2.0:1788796460.997600:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959247488 00000100:00100000:2.0:1788796460.997607:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959247488 00000100:00100000:2.0:1788796460.997689:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788796460.997697:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000011225067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+9:5867:x1875688959247488:12345-0@lo:502: 00000100:00100000:2.0:1788796460.997926:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000011225067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+9:5867:x1875688959247488:12345-0@lo:502: Request processed in 231us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796460.997933:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788796460.998042:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f11b9ba3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:5867:1875688959247488:0@lo:502: 00000020:01000000:3.0:1788796460.998065:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796460.998076:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796460.998078:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788796460.998083:0:5867:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788796460.998086:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788796460.998097:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d7196fd0) 00000020:00000080:3.0:1788796460.998114:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788796460.998119:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788796460.998198:0:5867:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788796460.998205:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd273c88cfe22381 00000020:00000080:3.0:1788796460.998474:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788796460.998479:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796460.998488:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796460.998489:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788796460.998492:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796460.998496:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796460.998497:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788796460.998500:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788796460.998507:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000092e886cf) 00000020:00000080:3.0:1788796460.998518:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788796460.998521:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788796460.998522:0:5867:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788796460.998525:0:5867:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788796460.998531:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788796460.998568:0:5867:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000042f868bc from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788796460.998579:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000006410f798) 00000020:00000080:3.0:1788796460.998586:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788796460.998642:0:5867:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788796460.998647:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd273c88cfe22396 00000020:00000080:3.0:1788796460.998726:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788796460.998732:0:5867:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788796460.998736:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdd273c88cfe2239d 00080000:01000000:3.0:1788796460.998741:0:5867:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788796460.998767:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd273c88cfe223a4 00080000:10000000:3.0:1788796460.999131:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788796460.999322:0:5867:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788796461.006300:0:5867:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788796461.103407:0:5867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788796461.105563:0:5867:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788796461.111942:0:5867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788796461.115129:0:5867:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788796461.250123:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000002908e20) 00000020:00000080:1.0:1788796461.250144:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788796461.250228:0:5867:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788796461.250236:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd273c88cfe223b2 00000020:00000080:1.0:1788796461.265493:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788796461.277140:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788796461.352322:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00010000:00010000:1.0:1788796461.412741:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788796461.454901:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788796461.521151:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788796461.553125:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796461.587513:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788796461.616743:0:5867:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdd273c88cfe223b9 00000020:00000080:3.0:1788796461.617162:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788796461.617172:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796461.617178:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796461.617187:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788796461.617191:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796461.617197:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796461.617297:0:5867:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788796461.617305:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788796461.617342:0:5867:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788796461.617367:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796461.617372:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796461.617373:0:5867:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788796461.617376:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796461.617379:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796461.617380:0:5867:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788796461.617383:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788796461.617384:0:5867:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788796461.617426:0:5867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f11b9ba3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:5867:1875688959247616:0@lo:502: 00000100:00100000:3.0:1788796461.617502:0:5867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796461.617695:0:5867:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fad5e37f going to sleep for 11 seconds 00000100:00100000:0.0:1788796461.617943:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959247616 00000100:00100000:0.0:1788796461.617951:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959247616 00000100:00100000:0.0:1788796461.618056:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788796461.618065:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000050e2cb86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+9:5867:x1875688959247616:12345-0@lo:502: 00000100:00100000:0.0:1788796461.622246:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000050e2cb86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+9:5867:x1875688959247616:12345-0@lo:502: Request processed in 4175us (4737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796461.622260:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788796461.622870:0:5867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f11b9ba3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:5867:1875688959247616:0@lo:502: 00000020:01000000:2.0:1788796461.622913:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796461.622921:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796461.622924:0:5867:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788796461.622927:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788796461.623083:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788796461.623111:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788796461.623129:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 00000000aaab94c3/0xdd273c88cfe2236c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22373 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.623139:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 00000000aaab94c3/0xdd273c88cfe2236c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22373 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796461.623146:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd250afa000 from 1 10000000:01000000:0.0:1788796461.623149:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788796461.623178:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000269e1210/0xdd273c88cfe223c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.623184:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000269e1210/0xdd273c88cfe223c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.623193:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000269e1210/0xdd273c88cfe223c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796461.623208:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e94886d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959247744:0@lo:101: 00000100:00100000:0.0:1788796461.623252:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796461.623299:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f396616a going to sleep for 11 seconds 00000100:00100000:1.0:1788796461.623403:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959247744 00000100:00100000:1.0:1788796461.623410:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959247744 00000100:00100000:1.0:1788796461.623451:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788796461.623459:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000586cdaa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+9:5822:x1875688959247744:12345-0@lo:101: 00010000:00010000:1.0:1788796461.623470:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796461.623483:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee674d40/0xdd273c88cfe223c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe223c0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796461.623518:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee674d40/0xdd273c88cfe223c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe223c0 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796461.623527:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee674d40/0xdd273c88cfe223c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe223c0 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796461.623534:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee674d40, rc 0) 00000100:00100000:1.0:1788796461.623578:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000586cdaa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+10:5822:x1875688959247744:12345-0@lo:101: Request processed in 120us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796461.623585:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788796461.623657:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e94886d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959247744:0@lo:101: 00010000:00010000:2.0:1788796461.623669:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000269e1210/0xdd273c88cfe223c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe223c7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796461.623677:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000269e1210/0xdd273c88cfe223c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe223c7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796461.624217:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000076e7552f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959247872:0@lo:256: 00000100:00100000:2.0:1788796461.624258:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796461.624288:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000170ded0e going to sleep for 11 seconds 00000100:00100000:0.0:1788796461.624370:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959247872 00000100:00100000:0.0:1788796461.624376:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959247872 00000100:00100000:0.0:1788796461.624415:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788796461.624421:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000490d433e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+10:5822:x1875688959247872:12345-0@lo:256: 20000000:01000000:0.0:1788796461.624434:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788796461.624439:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788796461.624508:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000490d433e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+10:5822:x1875688959247872:12345-0@lo:256: Request processed in 87us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796461.624515:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788796461.624523:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000076e7552f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959247872:0@lo:256: 10000000:01000000:2.0:1788796461.625103:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788796461.625128:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 00000000269e1210/0xdd273c88cfe223c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe223c7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796461.625139:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 00000000269e1210/0xdd273c88cfe223c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe223c7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796461.625154:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd250afa000 from 1 10000000:01000000:2.0:1788796461.625157:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788796461.625182:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000d1910adb/0xdd273c88cfe223ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796461.625189:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000d1910adb/0xdd273c88cfe223ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796461.625196:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000d1910adb/0xdd273c88cfe223ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796461.625210:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000076e7552f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959248000:0@lo:101: 00000100:00100000:2.0:1788796461.625243:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796461.625275:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000170ded0e going to sleep for 11 seconds 00000100:00100000:1.0:1788796461.625296:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959248000 00000100:00100000:1.0:1788796461.625302:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959248000 00000100:00100000:1.0:1788796461.625336:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788796461.625342:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035a8acea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+10:5822:x1875688959248000:12345-0@lo:101: 00010000:00010000:1.0:1788796461.625350:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796461.625371:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000023a30c72/0xdd273c88cfe223d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe223ce expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796461.625388:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000023a30c72/0xdd273c88cfe223d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe223ce expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796461.625406:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000023a30c72/0xdd273c88cfe223d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe223ce expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796461.625414:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000023a30c72, rc 0) 00000100:00100000:1.0:1788796461.625448:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035a8acea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+11:5822:x1875688959248000:12345-0@lo:101: Request processed in 107us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796461.625453:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788796461.625524:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000076e7552f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959248000:0@lo:101: 00010000:00010000:2.0:1788796461.625535:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000d1910adb/0xdd273c88cfe223ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe223d5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796461.625542:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000d1910adb/0xdd273c88cfe223ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe223d5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796461.625590:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000076e7552f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959248128:0@lo:501: 00000100:00100000:2.0:1788796461.625614:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796461.625635:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000170ded0e going to sleep for 11 seconds 00000100:00100000:1.0:1788796461.625651:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959248128 00000100:00100000:1.0:1788796461.625656:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959248128 00000100:00100000:1.0:1788796461.625681:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788796461.625687:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000098cdc0da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+11:5822:x1875688959248128:12345-0@lo:501: 00000100:00100000:1.0:1788796461.626166:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000098cdc0da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+11:5822:x1875688959248128:12345-0@lo:501: Request processed in 478us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796461.626172:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788796461.626325:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000076e7552f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959248128:0@lo:501: 00000100:00100000:2.0:1788796461.626353:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000076e7552f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959248256:0@lo:503: 00000100:00100000:2.0:1788796461.626420:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796461.626449:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000170ded0e going to sleep for 11 seconds 00000100:00100000:1.0:1788796461.626549:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959248256 00000100:00100000:1.0:1788796461.626554:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959248256 00000100:00100000:1.0:1788796461.626585:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788796461.626590:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000059e64488 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+11:5822:x1875688959248256:12345-0@lo:503: 00000040:00080000:1.0:1788796461.626623:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788796461.626672:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000059e64488 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+11:5822:x1875688959248256:12345-0@lo:503: Request processed in 82us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796461.626679:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788796461.626702:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000076e7552f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959248256:0@lo:503: 00000040:00080000:0.0:1788796461.628022:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788796461.628081:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788796461.628099:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788796461.628119:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 00000000d1910adb/0xdd273c88cfe223ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe223d5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796461.628130:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 00000000d1910adb/0xdd273c88cfe223ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe223d5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796461.628169:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788796461.628172:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd250afa000 10000000:01000000:2.0:1788796461.628175:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd250afa000 10000000:01000000:2.0:1788796461.628179:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788796461.628184:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd250afa000 from 1 10000000:01000000:2.0:1788796461.628187:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788796461.628213:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000fda6b86f/0xdd273c88cfe223dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796461.628220:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000fda6b86f/0xdd273c88cfe223dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796461.628228:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000fda6b86f/0xdd273c88cfe223dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796461.628245:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063aae8dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959248384:0@lo:101: 00000100:00100000:2.0:1788796461.628288:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796461.628325:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ae95719b going to sleep for 11 seconds 00000100:00100000:0.0:1788796461.628337:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959248384 00000100:00100000:0.0:1788796461.628344:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959248384 00000100:00100000:0.0:1788796461.628389:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788796461.628405:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ffdcd14a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+11:5822:x1875688959248384:12345-0@lo:101: 00010000:00010000:0.0:1788796461.628416:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796461.628427:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001e9d3052/0xdd273c88cfe223e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe223dc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.628446:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e9d3052/0xdd273c88cfe223e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe223dc expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.628455:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001e9d3052/0xdd273c88cfe223e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe223dc expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.628462:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001e9d3052, rc 0) 00000100:00100000:0.0:1788796461.628499:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ffdcd14a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:5822:x1875688959248384:12345-0@lo:101: Request processed in 104us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796461.628505:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788796461.628526:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063aae8dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959248384:0@lo:101: 00010000:00010000:2.0:1788796461.628537:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000fda6b86f/0xdd273c88cfe223dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe223e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796461.628554:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000fda6b86f/0xdd273c88cfe223dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe223e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796461.628594:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063aae8dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959248512:0@lo:501: 00000100:00100000:2.0:1788796461.628616:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796461.628637:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ae95719b going to sleep for 11 seconds 00000100:00100000:0.0:1788796461.628684:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959248512 00000100:00100000:0.0:1788796461.628689:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959248512 00000100:00100000:0.0:1788796461.628711:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788796461.628715:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000345d5854 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+12:5822:x1875688959248512:12345-0@lo:501: 00000100:00100000:0.0:1788796461.628927:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000345d5854 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+12:5822:x1875688959248512:12345-0@lo:501: Request processed in 211us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796461.628933:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788796461.628948:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063aae8dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959248512:0@lo:501: 00000100:00100000:2.0:1788796461.628971:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063aae8dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959248640:0@lo:503: 00000100:00100000:2.0:1788796461.629007:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796461.629140:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ae95719b going to sleep for 11 seconds 00000100:00100000:1.0:1788796461.629393:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959248640 00000100:00100000:1.0:1788796461.629663:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959248640 00000100:00100000:1.0:1788796461.629698:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788796461.629704:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000082c4b352 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:5822:x1875688959248640:12345-0@lo:503: 00000100:00100000:1.0:1788796461.631018:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000082c4b352 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:5822:x1875688959248640:12345-0@lo:503: Request processed in 1310us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796461.631030:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788796461.633407:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063aae8dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959248640:0@lo:503: 00000100:00100000:0.0:1788796461.633977:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca6f6786 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:5873:1875688959248768:0@lo:502: 00000100:00100000:0.0:1788796461.634046:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796461.634093:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b97c487 going to sleep for 11 seconds 00000100:00100000:1.0:1788796461.634143:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959248768 00000100:00100000:1.0:1788796461.634150:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959248768 00000100:00100000:1.0:1788796461.634195:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788796461.634212:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c6923f23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:5873:x1875688959248768:12345-0@lo:502: 00000100:00100000:1.0:1788796461.634484:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c6923f23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:5873:x1875688959248768:12345-0@lo:502: Request processed in 273us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796461.634497:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788796461.634513:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca6f6786 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:5873:1875688959248768:0@lo:502: 00000020:01000004:2.0:1788796461.634568:0:5873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788796461.634584:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006f513230) 00000020:00000080:2.0:1788796461.634603:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788796461.636588:0:5873:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000042f868bc from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788796461.636599:0:5873:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000042f868bc from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788796461.636602:0:5873:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000042f868bc 4 00010000:00080000:3.0:1788796461.636637:0:5873:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000793e5a70@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:3.0:1788796461.640661:0:5873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788796461.640886:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788796461.640924:0:5873:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788796461.640937:0:5873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdd273c88cfe223f1 00000100:00080000:3.0:1788796461.640949:0:5873:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788796461.640959:0:5873:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000793e5a70 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:3.0:1788796461.640998:0:5873:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008e4931d6 x1875688959248896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788796461.641031:0:5873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788796461.641090:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e4931d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875688959248896:0@lo:38: 00000100:00100000:2.0:1788796461.641171:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796461.647724:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959248896 00000100:00100000:3.0:1788796461.647742:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959248896 00000100:00100000:3.0:1788796461.647827:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796461.647835:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ccbd568 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875688959248896:12345-0@lo:38: 00000100:00100000:3.0:1788796461.647933:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ccbd568 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875688959248896:12345-0@lo:38: Request processed in 96us (6761us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788796461.647939:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788796461.648971:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788796461.648981:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000793e5a70 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788796461.648986:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788796461.648990:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e4931d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875688959248896:0@lo:38: 00000100:00100000:1.0:1788796461.652719:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000034bdb55b pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:5873:1875688959249024:0@lo:502: 00000100:00100000:1.0:1788796461.652829:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796461.652875:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 00000000add86301 going to sleep for 11 seconds 00000100:00100000:0.0:1788796461.653032:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959249024 00000100:00100000:0.0:1788796461.653040:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959249024 00000100:00100000:0.0:1788796461.653088:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788796461.653096:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb6d6fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:5873:x1875688959249024:12345-0@lo:502: 00000100:00100000:0.0:1788796461.653378:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb6d6fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:5873:x1875688959249024:12345-0@lo:502: Request processed in 282us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796461.653386:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788796461.656441:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000034bdb55b pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:5873:1875688959249024:0@lo:502: 00000040:00080000:3.0:1788796461.656490:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788796461.656710:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788796461.656730:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788796461.656770:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 00000000fda6b86f/0xdd273c88cfe223dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe223e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.656781:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 00000000fda6b86f/0xdd273c88cfe223dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe223e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788796461.656829:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788796461.656831:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788796461.656832:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788796461.656834:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788796461.656835:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788796461.656836:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788796461.656838:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788796461.656839:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788796461.656841:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788796461.656842:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788796461.656843:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788796461.656845:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788796461.656848:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788796461.656850:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788796461.656852:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788796461.656858:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788796461.656859:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788796461.656860:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788796461.656861:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788796461.656862:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788796461.656862:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788796461.656863:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788796461.656864:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788796461.656865:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788796461.656866:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788796461.656891:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788796461.656904:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003106c30c pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959249152:0@lo:253: 00000100:00100000:0.0:1788796461.656964:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796461.657002:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000006b9a7176 going to sleep for 11 seconds 00000100:00100000:1.0:1788796461.657061:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959249152 00000100:00100000:1.0:1788796461.657070:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959249152 00000100:00100000:1.0:1788796461.657118:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788796461.657126:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c6d0b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+12:5822:x1875688959249152:12345-0@lo:253: 20000000:01000000:1.0:1788796461.657150:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788796461.657162:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788796461.764363:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788796461.764386:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788796461.764592:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788796461.764598:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788796461.764620:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000faf01b2a/0xdd273c88cfe223f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796461.764642:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ee674d40/0xdd273c88cfe223c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe223c0 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796461.764651:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000faf01b2a/0xdd273c88cfe223f8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796461.764691:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ee674d40/0xdd273c88cfe223c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe223c0 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796461.764706:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ee674d40/0xdd273c88cfe223c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe223c0 expref: 12 pid: 5839 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796461.764720:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000343b61ee pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875688959249280:0@lo:104: 00000100:00100000:1.0:1788796461.764805:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796461.764880:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 00000000691ece22 going to sleep for 11 seconds 00000100:00100000:2.0:1788796461.768427:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959249280 00000100:00100000:2.0:1788796461.768447:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959249280 00000100:00100000:2.0:1788796461.768531:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788796461.768542:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c9b8e766 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f7145a2-0840-45a5-acde-da959fc7802f+3:5860:x1875688959249280:12345-0@lo:104: 00010000:00010000:2.0:1788796461.768561:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: 00000000269e1210/0xdd273c88cfe223c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe223c7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796461.768677:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788796461.768682:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c9b8e766 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f7145a2-0840-45a5-acde-da959fc7802f+3:5860:x1875688959249280:12345-0@lo:104: Request processed in 143us (3878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796461.768689:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788796461.768902:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796461.768907:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: 00000000269e1210/0xdd273c88cfe223c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe223c7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.768917:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000269e1210 already unused, calling callback (0000000041dedc5d) 10000000:00010000:0.0:1788796461.768921:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: 00000000269e1210/0xdd273c88cfe223c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe223c7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.768929:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: 00000000269e1210/0xdd273c88cfe223c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe223c7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796461.768935:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: 00000000269e1210/0xdd273c88cfe223c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe223c7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796461.768941:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796461.768987:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: 00000000269e1210/0xdd273c88cfe223c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe223c7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.768994:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796461.769012:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: 00000000269e1210/0xdd273c88cfe223c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe223c7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.769024:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: 00000000269e1210/0xdd273c88cfe223c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe223c7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.769042:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796461.769043:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796461.769045:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796461.769103:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a70b77fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959249408:0@lo:103: 00000100:00100000:0.0:1788796461.769145:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796461.769219:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959249408 00000100:00100000:0.0:1788796461.769224:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959249408 00010000:00010000:0.0:1788796461.769243:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ee674d40/0xdd273c88cfe223c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe223c0 expref: 13 pid: 5839 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796461.769266:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788796461.769272:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000950b366f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+13:3305:x1875688959249408:12345-0@lo:103: 00010000:00010000:0.0:1788796461.769282:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796461.769287:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ee674d40/0xdd273c88cfe223c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe223c0 expref: 13 pid: 5839 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.769297:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ee674d40/0xdd273c88cfe223c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe223c0 expref: 13 pid: 5839 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.769313:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000faf01b2a/0xdd273c88cfe223f8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.769322:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000faf01b2a/0xdd273c88cfe223f8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788796461.769337:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004739987s 00010000:00010000:0.0:1788796461.769347:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000faf01b2a/0xdd273c88cfe223f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.769364:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000faf01b2a/0xdd273c88cfe223f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.769371:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000faf01b2a/0xdd273c88cfe223f8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.769377:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000faf01b2a/0xdd273c88cfe223f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.769382:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000faf01b2a already unused, calling callback (000000008be5c8d8) 00010000:00010000:0.0:1788796461.769385:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000faf01b2a/0xdd273c88cfe223f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.769392:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000faf01b2a/0xdd273c88cfe223f8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.769400:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000faf01b2a/0xdd273c88cfe223f8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.769410:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796461.769440:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000950b366f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+13:3305:x1875688959249408:12345-0@lo:103: Request processed in 169us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796461.769446:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788796461.769646:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a70b77fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959249408:0@lo:103: 00010000:00010000:0.0:1788796461.769679:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ee674d40/0xdd273c88cfe223c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe223c0 expref: 12 pid: 5839 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796461.769691:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000343b61ee pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875688959249280:0@lo:104: 00010000:00010000:0.0:1788796461.769712:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000faf01b2a/0xdd273c88cfe223f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.769719:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000faf01b2a/0xdd273c88cfe223f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.769724:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000faf01b2a/0xdd273c88cfe223f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796461.769729:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000faf01b2a/0xdd273c88cfe223f8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796461.787438:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c6d0b3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:5822:x1875688959249152:12345-0@lo:253: Request processed in 130305us (130465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796461.787456:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788796461.787862:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003106c30c pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:5822:1875688959249152:0@lo:253: 10000000:01000000:0.0:1788796461.787880:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788796461.787883:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788796461.787885:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788796461.787886:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788796461.787887:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788796461.787889:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788796461.787890:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788796461.787891:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788796461.787892:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788796461.787894:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788796461.787895:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788796461.787896:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788796461.787898:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788796461.787911:0:5822:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788796461.805104:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788796461.808053:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788796461.810346:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788796461.810860:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788796461.811076:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788796461.812743:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788796461.814003:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788796461.814217:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788796461.814586:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788796461.814791:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788796461.814965:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788796461.815143:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1788796461.920907:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788796461.995128:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788796461.995503:0:5878:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788796461.995507:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788796461.995606:0:5879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788796462.016520:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788796462.016825:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788796462.017278:0:5822:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788796462.017286:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788796462.017422:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788796462.024618:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788796462.026209:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788796462.026278:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788796462.029500:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788796462.029731:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788796462.031000:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788796462.031142:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788796462.031296:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788796462.039232:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788796462.039462:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788796462.039615:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788796462.039778:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788796462.039924:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788796462.040051:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788796462.040198:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788796462.040336:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788796462.040498:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788796462.040654:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788796462.040821:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788796462.040962:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788796462.041106:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788796462.049162:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788796462.049539:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788796462.049669:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788796462.049828:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788796462.049952:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788796462.050092:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788796462.050221:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788796462.050379:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788796462.053612:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788796462.053968:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788796462.054133:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788796462.055797:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788796462.055989:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788796462.056138:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788796462.058440:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788796462.058654:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788796462.058872:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788796462.109472:0:5879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788796462.206104:0:5822:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788796462.206146:0:5822:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4d04192b988 00100000:10000000:3.0:1788796462.206153:0:5822:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788796462.208987:0:5822:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788796462.209004:0:5822:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788796462.209018:0:5822:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788796462.209036:0:5822:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788796462.277733:0:5879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788796462.277844:0:5879:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1788796462.277849:0:5879:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788796462.426291:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796463.450864:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796464.474024:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796465.498051:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796466.522069:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788796467.034244:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788796467.034254:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788796467.034257:0:8:0:(import.c:65:import_set_state_nolock()) 00000000793e5a70 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788796467.034282:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000793e5a70 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1788796467.034303:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b3e29563 x1875688959249664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788796467.034339:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3e29563 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875688959249664:0@lo:38: 00000100:00100000:1.0:1788796467.034401:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796467.034597:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002e2a3b61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959249536:0@lo:400: 00000100:00100000:3.0:1788796467.034638:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796467.034824:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959249536 00000100:00100000:1.0:1788796467.034831:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959249536 00000100:00100000:1.0:1788796467.034883:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788796467.034890:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b08009bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+11:3306:x1875688959249536:12345-0@lo:400: 00000100:00100000:1.0:1788796467.035056:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b08009bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+11:3306:x1875688959249536:12345-0@lo:400: Request processed in 166us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796467.035063:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788796467.035233:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002e2a3b61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959249536:0@lo:400: 00000100:00100000:2.0:1788796467.035493:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959249664 00000100:00100000:2.0:1788796467.035498:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959249664 00000100:00100000:2.0:1788796467.035530:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788796467.035535:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000b76b239 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875688959249664:12345-0@lo:38: 00010000:00080000:2.0:1788796467.035556:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1788796467.035589:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdd273c88cfe223ff 00000004:00100000:2.0:1788796467.035901:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788796467.036027:0:5846:0:(import.c:65:import_set_state_nolock()) 00000000f9b9f862 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788796467.036093:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000b76b239 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875688959249664:12345-0@lo:38: Request processed in 557us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796467.036100:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788796467.036464:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b3e29563 x1875688959249664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788796477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788796467.036478:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788796467.036484:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788796467.036488:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788796467.036490:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000793e5a70 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788796467.036495:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3e29563 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875688959249664:0@lo:38: 00010000:00010000:0.0:1788796467.546219:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788796467.551073:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788796467.551081:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd250afa000 from 3 10000000:01000000:3.0:1788796467.551085:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788796467.551134:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000ae812d4e/0xdd273c88cfe22406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796467.551147:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000ae812d4e/0xdd273c88cfe22406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796467.551157:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000ae812d4e/0xdd273c88cfe22406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796467.551177:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bdeee1d3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959249792:0@lo:101: 00000100:00100000:3.0:1788796467.551234:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796467.551287:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b2ce1c4f going to sleep for 11 seconds 00000100:00100000:1.0:1788796467.552408:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959249792 00000100:00100000:1.0:1788796467.552420:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959249792 00000100:00100000:1.0:1788796467.552471:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788796467.552479:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002eb66ea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:5841:x1875688959249792:12345-0@lo:101: 00010000:00010000:1.0:1788796467.552492:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796467.552508:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d00fb3d7/0xdd273c88cfe2240d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe22406 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796467.552531:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d00fb3d7/0xdd273c88cfe2240d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe22406 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796467.552540:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d00fb3d7/0xdd273c88cfe2240d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22406 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796467.552548:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d00fb3d7, rc 0) 00000100:00100000:1.0:1788796467.552599:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002eb66ea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+12:5841:x1875688959249792:12345-0@lo:101: Request processed in 121us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796467.552606:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788796467.552658:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bdeee1d3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959249792:0@lo:101: 00010000:00010000:1.0:1788796467.552671:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000ae812d4e/0xdd273c88cfe22406 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2240d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796467.552690:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000ae812d4e/0xdd273c88cfe22406 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe2240d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796467.552767:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3e29563 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959249920:0@lo:256: 00000100:00100000:1.0:1788796467.552796:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796467.552819:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000002582254b going to sleep for 11 seconds 00000100:00100000:1.0:1788796467.552835:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959249920 00000100:00100000:1.0:1788796467.552839:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959249920 00000100:00100000:1.0:1788796467.552856:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788796467.552861:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf573a91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:5841:x1875688959249920:12345-0@lo:256: 20000000:01000000:1.0:1788796467.552872:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788796467.552885:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788796467.552888:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788796467.552957:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf573a91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:5841:x1875688959249920:12345-0@lo:256: Request processed in 96us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796467.552964:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788796467.552987:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3e29563 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959249920:0@lo:256: 10000000:01000000:1.0:1788796467.553018:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788796467.553023:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 00000000ae812d4e/0xdd273c88cfe22406 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2240d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796467.553030:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 00000000ae812d4e/0xdd273c88cfe22406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2240d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1788796467.901095:0:6122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788796468.572026:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796469.593911:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796470.618216:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796471.644521:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796472.155506:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003106c30c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959250048:0@lo:400: 00000100:00100000:2.0:1788796472.155579:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796472.155690:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a70b77fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959250176:0@lo:400: 00000100:00100000:0.0:1788796472.155724:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796472.156259:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959250048 00000100:00100000:1.0:1788796472.156269:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959250048 00000100:00100000:1.0:1788796472.156310:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788796472.156317:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000bffef35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:3307:x1875688959250048:12345-0@lo:400: 00000100:00100000:0.0:1788796472.156466:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959250176 00000100:00100000:0.0:1788796472.156470:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959250176 00000100:00100000:0.0:1788796472.156506:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788796472.156513:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000037346515 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959250176:12345-0@lo:400: 00000100:00100000:0.0:1788796472.156556:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000037346515 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959250176:12345-0@lo:400: Request processed in 44us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796472.156562:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788796472.156599:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a70b77fb x1875688959250176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796472.156615:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a70b77fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959250176:0@lo:400: 00000100:00100000:1.0:1788796472.156870:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000bffef35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:3307:x1875688959250048:12345-0@lo:400: Request processed in 553us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796472.156877:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788796472.159954:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003106c30c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959250048:0@lo:400: 00010000:00010000:2.0:1788796472.666516:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788796472.987852:0:6324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe19d6df20 20000000:00000080:1.0:1788796472.987870:0:6324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd250422000 uarg=0000000000000000 20000000:01000000:1.0:1788796472.987910:0:6324:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788796472.987918:0:6324:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788796472.987923:0:6324:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788796472.990350:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788796472.990367:0:6324:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788796473.001737:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788796473.002722:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788796473.002806:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788796473.002861:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788796473.002881:0:6324:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788796473.002899:0:6324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c2867882/0xdd273c88cfe22414 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796473.002918:0:6324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000023a30c72/0xdd273c88cfe223d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe223ce expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796473.002925:0:6324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c2867882/0xdd273c88cfe22414 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796473.002962:0:6324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000023a30c72/0xdd273c88cfe223d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe223ce expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796473.002977:0:6324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000023a30c72/0xdd273c88cfe223d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe223ce expref: 11 pid: 5837 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796473.003005:0:6324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3e29563 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1875688959250304:0@lo:104: 00000100:00100000:1.0:1788796473.003073:0:6324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796473.003124:0:6324:0:(client.c:2716:ptlrpc_set_wait()) set 000000002582254b going to sleep for 11 seconds 00000100:00100000:3.0:1788796473.008898:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959250304 00000100:00100000:3.0:1788796473.008915:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959250304 00000100:00100000:3.0:1788796473.008972:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788796473.008980:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e2a3b61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:6324:x1875688959250304:12345-0@lo:104: 00010000:00010000:3.0:1788796473.008997:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: 00000000d1910adb/0xdd273c88cfe223ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe223d5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796473.009103:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788796473.009109:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e2a3b61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:6324:x1875688959250304:12345-0@lo:104: Request processed in 130us (6036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796473.009116:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788796473.009116:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796473.009121:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: 00000000d1910adb/0xdd273c88cfe223ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe223d5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009128:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d1910adb already unused, calling callback (0000000041dedc5d) 10000000:00010000:2.0:1788796473.009131:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: 00000000d1910adb/0xdd273c88cfe223ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe223d5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009139:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: 00000000d1910adb/0xdd273c88cfe223ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe223d5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796473.009146:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: 00000000d1910adb/0xdd273c88cfe223ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe223d5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796473.009152:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788796473.009209:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: 00000000d1910adb/0xdd273c88cfe223ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe223d5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009216:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796473.009240:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: 00000000d1910adb/0xdd273c88cfe223ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe223d5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009246:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: 00000000d1910adb/0xdd273c88cfe223ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe223d5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009272:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796473.009273:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796473.009274:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796473.009282:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796473.009296:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8a9e8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959250432:0@lo:103: 00000100:00100000:2.0:1788796473.009333:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796473.009377:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959250432 00000100:00100000:2.0:1788796473.009381:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959250432 00010000:00010000:2.0:1788796473.009399:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000023a30c72/0xdd273c88cfe223d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe223ce expref: 12 pid: 5837 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796473.009419:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788796473.009425:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035afbe70 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+12:3304:x1875688959250432:12345-0@lo:103: 00010000:00010000:2.0:1788796473.009433:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796473.009437:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000023a30c72/0xdd273c88cfe223d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe223ce expref: 12 pid: 5837 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009445:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000023a30c72/0xdd273c88cfe223d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe223ce expref: 12 pid: 5837 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009459:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c2867882/0xdd273c88cfe22414 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009466:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c2867882/0xdd273c88cfe22414 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009479:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c2867882/0xdd273c88cfe22414 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009494:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c2867882/0xdd273c88cfe22414 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009499:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c2867882/0xdd273c88cfe22414 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009504:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c2867882/0xdd273c88cfe22414 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009508:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c2867882 already unused, calling callback (000000008be5c8d8) 00010000:00010000:2.0:1788796473.009511:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c2867882/0xdd273c88cfe22414 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009516:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c2867882/0xdd273c88cfe22414 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009522:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c2867882/0xdd273c88cfe22414 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.009531:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796473.009556:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035afbe70 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+12:3304:x1875688959250432:12345-0@lo:103: Request processed in 132us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796473.009562:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788796473.009593:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8a9e8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959250432:0@lo:103: 00010000:00010000:1.0:1788796473.009734:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000023a30c72/0xdd273c88cfe223d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe223ce expref: 11 pid: 5837 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796473.009779:0:6324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3e29563 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1875688959250304:0@lo:104: 00010000:00010000:1.0:1788796473.009799:0:6324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c2867882/0xdd273c88cfe22414 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796473.009807:0:6324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c2867882/0xdd273c88cfe22414 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796473.009812:0:6324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c2867882/0xdd273c88cfe22414 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796473.009816:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c2867882/0xdd273c88cfe22414 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796473.689913:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796474.714844:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788796475.677701:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788796475.677707:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd250afa000 from 1 10000000:01000000:1.0:1788796475.677712:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788796475.677781:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000faf01b2a/0xdd273c88cfe2241b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796475.677795:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000faf01b2a/0xdd273c88cfe2241b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796475.677806:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000faf01b2a/0xdd273c88cfe2241b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796475.677826:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3e29563 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959250560:0@lo:101: 00000100:00100000:1.0:1788796475.677886:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796475.677926:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b19e603 going to sleep for 11 seconds 00000100:00100000:0.0:1788796475.678799:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959250560 00000100:00100000:0.0:1788796475.678811:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959250560 00000100:00100000:0.0:1788796475.678861:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788796475.678869:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ccc8c02f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:5841:x1875688959250560:12345-0@lo:101: 00010000:00010000:0.0:1788796475.678882:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796475.678897:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d9e6bc43/0xdd273c88cfe22422 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2241b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796475.678919:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d9e6bc43/0xdd273c88cfe22422 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2241b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796475.678929:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d9e6bc43/0xdd273c88cfe22422 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2241b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796475.678937:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d9e6bc43, rc 0) 00000100:00100000:0.0:1788796475.679172:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ccc8c02f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+12:5841:x1875688959250560:12345-0@lo:101: Request processed in 303us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796475.679179:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788796475.679245:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3e29563 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959250560:0@lo:101: 00010000:00010000:0.0:1788796475.679261:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000faf01b2a/0xdd273c88cfe2241b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22422 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796475.679269:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000faf01b2a/0xdd273c88cfe2241b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22422 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796475.679354:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a70b77fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959250688:0@lo:501: 00000100:00100000:0.0:1788796475.679382:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796475.679410:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000226f3d62 going to sleep for 11 seconds 00000100:00100000:0.0:1788796475.679423:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959250688 00000100:00100000:0.0:1788796475.679427:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959250688 00000100:00100000:0.0:1788796475.679447:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788796475.679453:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000129e768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:5841:x1875688959250688:12345-0@lo:501: 00000100:00100000:0.0:1788796475.680057:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000129e768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:5841:x1875688959250688:12345-0@lo:501: Request processed in 601us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796475.680065:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788796475.680105:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a70b77fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959250688:0@lo:501: 00000100:00100000:0.0:1788796475.680146:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a70b77fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959250816:0@lo:503: 00000100:00100000:0.0:1788796475.680185:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796475.680200:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000226f3d62 going to sleep for 11 seconds 00000100:00100000:0.0:1788796475.680213:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959250816 00000100:00100000:0.0:1788796475.680218:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959250816 00000100:00100000:0.0:1788796475.680252:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788796475.680259:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000069123cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:5841:x1875688959250816:12345-0@lo:503: 00000100:00100000:0.0:1788796475.680445:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000069123cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:5841:x1875688959250816:12345-0@lo:503: Request processed in 187us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796475.680452:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788796475.680490:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a70b77fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959250816:0@lo:503: 00000100:00100000:0.0:1788796475.684373:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a70b77fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:6494:1875688959250944:0@lo:502: 00000100:00100000:0.0:1788796475.684460:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796475.684505:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041b11b5d going to sleep for 11 seconds 00000100:00100000:1.0:1788796475.684628:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959250944 00000100:00100000:1.0:1788796475.684637:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959250944 00000100:00100000:1.0:1788796475.684682:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788796475.684690:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000089336a77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:6494:x1875688959250944:12345-0@lo:502: 00000100:00100000:1.0:1788796475.684925:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000089336a77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:6494:x1875688959250944:12345-0@lo:502: Request processed in 236us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796475.684933:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788796475.685280:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a70b77fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:6494:1875688959250944:0@lo:502: 00000020:01000000:0.0:1788796475.685426:0:6494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788796475.685437:0:6494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796475.685445:0:6494:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788796475.685453:0:6494:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd250afa000 00000020:00000080:0.0:1788796475.685455:0:6494:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788796475.685501:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c621180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:6494:1875688959251072:0@lo:502: 00000100:00100000:0.0:1788796475.685538:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796475.685618:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd251ba56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796475.689473:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959251072 00000100:00100000:1.0:1788796475.689487:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959251072 00000100:00100000:1.0:1788796475.689540:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788796475.689551:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:6494:x1875688959251072:12345-0@lo:502: 00000100:00100000:1.0:1788796475.694045:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:6494:x1875688959251072:12345-0@lo:502: Request processed in 4486us (8496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796475.694062:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788796475.697828:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c621180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:6494:1875688959251072:0@lo:502: 00000020:01000000:2.0:1788796475.697871:0:6494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796475.697879:0:6494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796475.697887:0:6494:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788796475.697892:0:6494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788796475.697952:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788796475.697976:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788796475.697986:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd282052200/0xdd273c88cfe2241b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22422 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796475.697999:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd282052200/0xdd273c88cfe2241b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22422 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796475.739252:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796476.761923:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796477.274027:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959251200:0@lo:400: 00000100:00100000:3.0:1788796477.274156:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796477.274614:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959251200 00000100:00100000:1.0:1788796477.274625:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959251200 00000100:00100000:1.0:1788796477.274683:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788796477.274693:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+12:3306:x1875688959251200:12345-0@lo:400: 00000100:00100000:2.0:1788796477.274882:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959251328:0@lo:400: 00000100:00100000:2.0:1788796477.274913:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796477.274955:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959251328 00000100:00100000:2.0:1788796477.274959:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959251328 00000100:00100000:2.0:1788796477.274988:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788796477.274994:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959251328:12345-0@lo:400: 00000100:00100000:2.0:1788796477.275052:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959251328:12345-0@lo:400: Request processed in 58us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796477.275059:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788796477.275107:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd26c622d80 x1875688959251328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796477.275121:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959251328:0@lo:400: 00000100:00100000:1.0:1788796477.275572:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+12:3306:x1875688959251200:12345-0@lo:400: Request processed in 879us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796477.275580:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788796477.275818:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959251200:0@lo:400: 00010000:00010000:1.0:1788796477.790796:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796478.810242:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788796479.253059:0:6689:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788796479.253063:0:6689:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788796479.253324:0:6689:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd2467d7000 00000020:01000004:1.0:1788796479.253339:0:6689:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788796479.253350:0:6689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788796479.253364:0:6689:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bd246073370) 00000020:00000080:1.0:1788796479.253380:0:6689:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788796479.296269:0:6689:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788796479.296515:0:6689:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788796479.345631:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788796479.356282:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788796479.356321:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788796479.356390:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788796479.356434:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788796479.358095:0:6689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788796479.358110:0:6689:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788796479.358123:0:6689:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdd273c88cfe22430 00000020:01000004:2.0:1788796479.358132:0:6689:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788796479.358152:0:6689:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788796479.358155:0:6689:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788796479.358161:0:6689:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788796479.358166:0:6689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788796479.358179:0:6689:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bd26caa19b8) 00000020:00000080:2.0:1788796479.358191:0:6689:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788796479.359469:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788796479.359636:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788796479.359651:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788796479.363982:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788796479.363998:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788796479.373030:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788796479.373060:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788796479.382190:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788796479.382660:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788796479.382667:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788796479.383396:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788796479.383404:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788796479.414018:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788796479.414294:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788796479.414301:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788796479.416111:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788796479.416124:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788796479.417678:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788796479.417692:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788796479.422031:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788796479.422256:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788796479.422263:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788796479.425428:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788796479.425442:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788796479.509687:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788796479.510490:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788796479.510495:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788796479.513933:0:6689:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788796479.513952:0:6689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788796479.514573:0:6689:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788796479.514607:0:6689:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788796479.514614:0:6689:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788796479.542316:0:6689:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788796479.542356:0:6689:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.125@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788796479.542360:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788796479.542366:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788796479.542368:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788796479.542369:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788796479.542370:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788796479.542371:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788796479.542373:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788796479.542374:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788796479.542375:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788796479.542377:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788796479.542378:0:6689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788796479.542382:0:6689:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788796479.542385:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788796479.542386:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788796479.542387:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788796479.542388:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788796479.542389:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788796479.542390:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788796479.542391:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788796479.542392:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788796479.542393:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788796479.542394:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788796479.542395:0:6689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788796479.542422:0:6689:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788796479.542442:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959251456:0@lo:253: 00000100:00100000:1.0:1788796479.542513:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796479.542629:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247cc7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796479.543194:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959251456 00000100:00100000:2.0:1788796479.543204:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959251456 00000100:00100000:2.0:1788796479.543287:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788796479.543298:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:6689:x1875688959251456:12345-0@lo:253: 20000000:01000000:2.0:1788796479.543338:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788796479.543342:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788796479.543347:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788796479.543351:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788796479.544412:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788796479.544634:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788796479.544646:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788796479.544685:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788796479.544693:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788796479.544719:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788796479.544870:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788796479.545331:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788796479.545351:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.125@tcp 20000000:01000000:2.0:1788796479.545353:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.125@tcp (null) (null) (null) 00000040:00080000:2.0:1788796479.545384:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788796479.545392:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788796479.545437:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788796479.545444:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.125@tcp (null) (null) 00000040:00080000:2.0:1788796479.545476:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788796479.545485:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788796479.545516:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788796479.545563:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788796479.547375:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788796479.547403:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.125@tcp 20000000:01000000:2.0:1788796479.547406:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.125@tcp (null) (null) (null) 00000040:00080000:2.0:1788796479.547437:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788796479.547443:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788796479.547468:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788796479.547474:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.125@tcp (null) (null) 00000040:00080000:2.0:1788796479.547516:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788796479.547526:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788796479.547565:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788796479.547592:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788796479.547607:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788796479.547610:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788796479.547615:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788796479.547617:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788796479.547619:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788796479.547632:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788796479.547634:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788796479.547663:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788796479.547665:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788796479.551946:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788796479.552040:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788796479.552119:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788796479.552469:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788796479.552509:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788796479.552562:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788796479.552575:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788796479.552578:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788796479.553187:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1788796479.553239:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1788796479.553289:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788796479.553537:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788796479.553587:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788796479.553620:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788796479.553630:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788796479.553632:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788796479.554205:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788796479.554415:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788796479.554456:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788796479.554518:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:1.0:1788796479.554540:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788796479.554559:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2243e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.554577:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd282053000/0xdd273c88cfe22357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22350 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.554585:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd24152e000/0xdd273c88cfe22373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2236c expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.554597:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe223e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe223dc expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.554604:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2243e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.554640:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe223e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe223dc expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.554653:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe223e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe223dc expref: 12 pid: 5839 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796479.554667:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959251584:0@lo:104: 00000100:00100000:1.0:1788796479.554735:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796479.555063:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd24152e000/0xdd273c88cfe22373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe2236c expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.555072:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd24152e000/0xdd273c88cfe22373 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe2236c expref: 12 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796479.555081:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959251712:0@lo:104: 00000100:00100000:1.0:1788796479.555117:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796479.555243:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd282053000/0xdd273c88cfe22357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe22350 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.555252:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd282053000/0xdd273c88cfe22357 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe22350 expref: 12 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796479.555260:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959251840:0@lo:104: 00000100:00100000:1.0:1788796479.556878:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796479.557062:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959251584 00000100:00100000:0.0:1788796479.557070:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959251584 00000100:00100000:0.0:1788796479.557112:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959251712 00000100:00100000:0.0:1788796479.557114:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959251712 00000100:00100000:0.0:1788796479.557126:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788796479.557144:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+4:5839:x1875688959251584:12345-0@lo:104: 00010000:00010000:0.0:1788796479.557159:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd24152f800/0xdd273c88cfe223dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe223e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557216:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788796479.557222:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+4:5839:x1875688959251584:12345-0@lo:104: Request processed in 80us (2488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796479.557228:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788796479.557244:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788796479.557250:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:5839:x1875688959251712:12345-0@lo:104: 00010000:00010000:0.0:1788796479.557258:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd240031400/0xdd273c88cfe2236c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22373 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557290:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788796479.557294:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:5839:x1875688959251712:12345-0@lo:104: Request processed in 46us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796479.557300:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788796479.557318:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788796479.557323:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd24152f800/0xdd273c88cfe223dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe223e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557330:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152f800 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796479.557334:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152f800/0xdd273c88cfe223dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe223e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557342:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd24152f800/0xdd273c88cfe223dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe223e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796479.557350:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152f800/0xdd273c88cfe223dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe223e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796479.557362:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796479.557396:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd24152f800/0xdd273c88cfe223dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe223e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557403:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796479.557419:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd24152f800/0xdd273c88cfe223dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe223e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557426:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd24152f800/0xdd273c88cfe223dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe223e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557442:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796479.557445:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd240031400/0xdd273c88cfe2236c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22373 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557450:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031400 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796479.557453:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd240031400/0xdd273c88cfe2236c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe22373 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557460:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd240031400/0xdd273c88cfe2236c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe22373 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796479.557466:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd240031400/0xdd273c88cfe2236c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe22373 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796479.557471:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796479.557479:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd240031400/0xdd273c88cfe2236c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22373 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557484:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796479.557494:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd240031400/0xdd273c88cfe2236c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22373 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557501:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd240031400/0xdd273c88cfe2236c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22373 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557509:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796479.557511:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796479.557512:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796479.557532:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959251968:0@lo:103: 00000100:00100000:0.0:1788796479.557558:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796479.557591:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796479.557595:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959252096:0@lo:103: 00000100:00100000:0.0:1788796479.557611:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796479.557632:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959251968 00000100:00100000:0.0:1788796479.557636:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959251968 00010000:00010000:0.0:1788796479.557651:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe223e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe223dc expref: 13 pid: 5839 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796479.557669:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959252096 00000100:00100000:0.0:1788796479.557671:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959252096 00010000:00010000:0.0:1788796479.557678:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd24152e000/0xdd273c88cfe22373 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2236c expref: 14 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796479.557689:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788796479.557694:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c622300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+14:3304:x1875688959251968:12345-0@lo:103: 00010000:00010000:0.0:1788796479.557703:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796479.557708:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe223e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe223dc expref: 14 pid: 5839 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557727:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe223e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe223dc expref: 14 pid: 5839 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557777:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796479.557806:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c622300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+14:3304:x1875688959251968:12345-0@lo:103: Request processed in 111us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796479.557812:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788796479.557824:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788796479.557830:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c622680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+13:3304:x1875688959252096:12345-0@lo:103: 00010000:00010000:0.0:1788796479.557837:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796479.557841:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd24152e000/0xdd273c88cfe22373 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2236c expref: 13 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557849:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd24152e000/0xdd273c88cfe22373 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe2236c expref: 13 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.557858:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796479.557876:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c622680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+13:3304:x1875688959252096:12345-0@lo:103: Request processed in 46us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796479.557882:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788796479.557931:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959252096:0@lo:103: 00000100:00100000:0.0:1788796479.557939:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959251968:0@lo:103: 00010000:00010000:2.0:1788796479.558287:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796479.558373:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247cc7000 going to sleep for 11 seconds 00010000:00010000:1.0:1788796479.558390:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe223e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe223dc expref: 12 pid: 5839 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796479.558402:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959251584:0@lo:104: 00010000:00010000:1.0:1788796479.558412:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd24152e000/0xdd273c88cfe22373 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe2236c expref: 11 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796479.558422:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959251712:0@lo:104: 00000100:00100000:0.0:1788796479.558470:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959251840 00000100:00100000:0.0:1788796479.558476:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959251840 00000100:00100000:0.0:1788796479.558500:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788796479.558507:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:5839:x1875688959251840:12345-0@lo:104: 00010000:00010000:0.0:1788796479.558527:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd240030200/0xdd273c88cfe22350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796479.558699:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959251840:0@lo:104: 00010000:00010000:1.0:1788796479.558722:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2243e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.558781:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788796479.558787:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:5839:x1875688959251840:12345-0@lo:104: Request processed in 281us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796479.558794:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788796479.559004:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796479.559011:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd240030200/0xdd273c88cfe22350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559017:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240030200 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:2.0:1788796479.559020:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd240030200/0xdd273c88cfe22350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe22357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559028:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd240030200/0xdd273c88cfe22350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe22357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796479.559057:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd240030200/0xdd273c88cfe22350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe22357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796479.559063:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788796479.559095:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd240030200/0xdd273c88cfe22350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559101:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796479.559121:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd240030200/0xdd273c88cfe22350 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559127:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd240030200/0xdd273c88cfe22350 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22357 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559141:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796479.559142:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796479.559144:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796479.559187:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959252224:0@lo:103: 00000100:00100000:3.0:1788796479.559223:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796479.559353:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959252224 00000100:00100000:2.0:1788796479.559359:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959252224 00010000:00010000:2.0:1788796479.559379:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd282053000/0xdd273c88cfe22357 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22350 expref: 11 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796479.559431:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788796479.559438:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+11:3306:x1875688959252224:12345-0@lo:103: 00010000:00010000:2.0:1788796479.559448:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796479.559453:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd282053000/0xdd273c88cfe22357 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22350 expref: 11 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559462:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd282053000/0xdd273c88cfe22357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe22350 expref: 11 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559482:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd282053000/0xdd273c88cfe22357 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe22350 expref: 11 pid: 5837 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559496:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2243e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559505:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2243e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559519:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2243e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559526:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2243e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559533:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2243e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559539:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2243e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559543:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd282053400 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796479.559547:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2243e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559553:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2243e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559570:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2243e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.559588:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796479.559623:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+10:3306:x1875688959252224:12345-0@lo:103: Request processed in 186us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796479.559629:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788796479.559681:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959252224:0@lo:103: 00010000:00010000:1.0:1788796479.559727:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2243e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.559734:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2243e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.559739:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2243e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788796479.559767:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788796479.607785:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+9:6689:x1875688959251456:12345-0@lo:253: Request processed in 64479us (65261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796479.607800:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788796479.607906:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959251456:0@lo:253: 10000000:01000000:2.0:1788796479.607920:0:6689:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788796479.607923:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788796479.607925:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788796479.607926:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796479.607928:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788796479.607929:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796479.607930:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796479.607932:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788796479.607933:0:6689:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788796479.607934:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796479.607936:0:6689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788796479.607954:0:6689:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd2467d7000 from lustre-OST0000 10000000:01000000:2.0:1788796479.607975:0:6689:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788796479.607978:0:6689:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788796479.607984:0:6689:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd26caa3370 local copy 10000000:01000000:2.0:1788796479.607988:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788796479.608021:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.608032:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.608050:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796479.608067:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959252352:0@lo:101: 00000100:00100000:2.0:1788796479.608111:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796479.608303:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788796479.608458:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959252352 00000100:00100000:1.0:1788796479.608464:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959252352 00000100:00100000:1.0:1788796479.608501:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788796479.608516:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+9:6689:x1875688959252352:12345-0@lo:101: 00010000:00010000:1.0:1788796479.608528:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796479.608540:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2244c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe22445 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.608561:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2244c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe22445 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.608572:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2244c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22445 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.608580:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd282053400, rc 0) 00000100:00100000:1.0:1788796479.608651:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+10:6689:x1875688959252352:12345-0@lo:101: Request processed in 136us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796479.608657:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788796479.608734:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959252352:0@lo:101: 00010000:00010000:3.0:1788796479.608815:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22445 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd273c88cfe2244c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796479.608825:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22445 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd273c88cfe2244c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796479.609025:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959252480:0@lo:501: 00000100:00100000:2.0:1788796479.609060:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796479.609117:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83900 going to sleep for 11 seconds 00000100:00100000:1.0:1788796479.609201:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959252480 00000100:00100000:1.0:1788796479.609206:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959252480 00000100:00100000:1.0:1788796479.609333:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788796479.609341:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+10:6689:x1875688959252480:12345-0@lo:501: 00000100:00100000:1.0:1788796479.609537:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+10:6689:x1875688959252480:12345-0@lo:501: Request processed in 197us (475us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788796479.609544:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788796479.609602:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959252480:0@lo:501: 10000000:01000000:2.0:1788796479.609614:0:6689:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788796479.609637:0:6689:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788796479.609642:0:6689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22445 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd273c88cfe2244c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.609651:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22445 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd273c88cfe2244c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.609658:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd273c88cfe2244c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.609681:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788796479.609699:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd2467d7000 10000000:01000000:2.0:1788796479.609703:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788796479.609707:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bd26caa3370 10000000:01000000:2.0:1788796479.609709:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788796479.609712:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9bd26caa3370 from 1 10000000:01000000:2.0:1788796479.609714:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788796479.609731:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152f200/0xdd273c88cfe22453 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.609738:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd24152f200/0xdd273c88cfe22453 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.609775:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd24152f200/0xdd273c88cfe22453 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796479.609788:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959252608:0@lo:101: 00000100:00100000:2.0:1788796479.609812:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788796479.609853:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796479.609860:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdd273c88cfe2244c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796479.609878:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152e400 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:3.0:1788796479.609882:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdd273c88cfe2244c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796479.609899:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22445 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xdd273c88cfe2244c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788796479.609906:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22445 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xdd273c88cfe2244c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796479.609912:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788796479.609932:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22445 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd273c88cfe2244c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796479.609939:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788796479.609958:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22445 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd273c88cfe2244c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796479.609965:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22445 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd273c88cfe2244c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796479.609980:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796479.609982:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796479.609983:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796479.609990:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796479.610001:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959252736:0@lo:103: 00000100:00100000:3.0:1788796479.610031:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796479.610081:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959252736 00000100:00100000:3.0:1788796479.610086:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959252736 00000100:00100000:3.0:1788796479.610139:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796479.610145:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f7145a2-0840-45a5-acde-da959fc7802f+10:3306:x1875688959252736:12345-0@lo:103: 00010000:00010000:3.0:1788796479.610155:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796479.610167:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd282053400/0xdd273c88cfe2244c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd273c88cfe22445 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796479.610180:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796479.610206:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f7145a2-0840-45a5-acde-da959fc7802f+9:3306:x1875688959252736:12345-0@lo:103: Request processed in 62us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796479.610212:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796479.610238:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959252736:0@lo:103: 00000100:00100000:2.0:1788796479.610557:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83780 going to sleep for 11 seconds 00000100:00100000:0.0:1788796479.610624:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959252608 00000100:00100000:0.0:1788796479.610629:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959252608 00000100:00100000:0.0:1788796479.610653:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788796479.610660:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+9:6689:x1875688959252608:12345-0@lo:101: 00010000:00010000:0.0:1788796479.610668:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796479.610681:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd240031400/0xdd273c88cfe2245a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe22453 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.610700:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd240031400/0xdd273c88cfe2245a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe22453 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.610710:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd240031400/0xdd273c88cfe2245a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22453 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.610717:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240031400, rc 0) 00000100:00100000:0.0:1788796479.610773:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+10:6689:x1875688959252608:12345-0@lo:101: Request processed in 113us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796479.610779:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788796479.610857:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959252608:0@lo:101: 00010000:00010000:2.0:1788796479.610869:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd24152f200/0xdd273c88cfe22453 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2245a expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.610877:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd24152f200/0xdd273c88cfe22453 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe2245a expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796479.610902:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788796479.610918:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152f200/0xdd273c88cfe22453 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2245a expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.610925:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd24152f200/0xdd273c88cfe22453 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2245a expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796479.610932:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788796479.610936:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788796479.610940:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788796479.610943:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788796479.610957:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe22461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.610964:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe22461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.610979:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe22461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796479.610992:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959252864:0@lo:101: 00000100:00100000:2.0:1788796479.611018:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796479.611038:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83780 going to sleep for 11 seconds 00000100:00100000:2.0:1788796479.611063:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959252864 00000100:00100000:2.0:1788796479.611067:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959252864 00000100:00100000:2.0:1788796479.611085:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788796479.611090:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+10:6689:x1875688959252864:12345-0@lo:101: 00010000:00010000:2.0:1788796479.611096:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796479.611104:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd24152e800/0xdd273c88cfe22468 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe22461 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.611117:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd24152e800/0xdd273c88cfe22468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe22461 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.611313:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd24152e800/0xdd273c88cfe22468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22461 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.611321:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd24152e800, rc 0) 00000100:00100000:2.0:1788796479.611350:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:6689:x1875688959252864:12345-0@lo:101: Request processed in 260us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796479.611356:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788796479.611387:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959252864:0@lo:101: 00010000:00010000:2.0:1788796479.611398:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe22461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22468 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.611416:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe22461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22468 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796479.611489:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959252992:0@lo:501: 00000100:00100000:2.0:1788796479.611510:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796479.611522:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83780 going to sleep for 11 seconds 00000100:00100000:2.0:1788796479.611533:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959252992 00000100:00100000:2.0:1788796479.611537:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959252992 00000100:00100000:2.0:1788796479.611551:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788796479.611556:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:6689:x1875688959252992:12345-0@lo:501: 00000100:00100000:2.0:1788796479.611725:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:6689:x1875688959252992:12345-0@lo:501: Request processed in 168us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796479.611731:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788796479.611779:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959252992:0@lo:501: 00000100:00100000:2.0:1788796479.611802:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959253120:0@lo:503: 00000100:00100000:2.0:1788796479.611836:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796479.611853:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83780 going to sleep for 11 seconds 00000100:00100000:2.0:1788796479.611864:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959253120 00000100:00100000:2.0:1788796479.611867:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959253120 00000100:00100000:2.0:1788796479.611881:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788796479.611999:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:6689:x1875688959253120:12345-0@lo:503: 00000100:00100000:2.0:1788796479.612240:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:6689:x1875688959253120:12345-0@lo:503: Request processed in 242us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796479.612314:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788796479.612535:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959253120:0@lo:503: 00000040:00080000:0.0:1788796479.612870:0:6689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788796479.612980:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c621880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959253248:0@lo:502: 00000100:00100000:0.0:1788796479.613022:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796479.613091:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26737e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788796479.613183:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959253248 00000100:00100000:2.0:1788796479.613193:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959253248 00000100:00100000:2.0:1788796479.613330:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788796479.613338:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:6689:x1875688959253248:12345-0@lo:502: 00000100:00100000:2.0:1788796479.613524:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:6689:x1875688959253248:12345-0@lo:502: Request processed in 187us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796479.613531:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788796479.613613:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c621880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959253248:0@lo:502: 00000040:00080000:0.0:1788796479.614029:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788796479.614095:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788796479.614218:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788796479.614373:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788796479.614408:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788796479.614433:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788796479.614462:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c621880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959253376:0@lo:502: 00000100:00100000:0.0:1788796479.614507:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796479.614584:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26737e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788796479.614646:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959253376 00000100:00100000:2.0:1788796479.614652:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959253376 00000100:00100000:2.0:1788796479.614690:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788796479.614698:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:6689:x1875688959253376:12345-0@lo:502: 00000100:00100000:2.0:1788796479.614869:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:6689:x1875688959253376:12345-0@lo:502: Request processed in 171us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796479.614876:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788796479.615082:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c621880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959253376:0@lo:502: 00000040:00080000:0.0:1788796479.615806:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788796479.615820:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788796479.616689:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788796479.616698:0:6707:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788796479.616705:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796479.616707:0:6707:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788796479.616712:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788796479.616735:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bd2673e0000) 00000020:00000080:0.0:1788796479.616769:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788796479.616776:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788796479.616833:0:6707:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd2467d7000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788796479.616841:0:6707:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788796479.616847:0:6707:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdd273c88cfe22476 00010000:00010000:0.0:1788796479.623306:0:6707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788796479.623711:0:6707:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788796479.627446:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788796479.627849:0:6707:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788796479.636433:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788796479.637117:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788796479.639475:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788796479.639487:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788796479.639500:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796479.639502:0:6707:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788796479.639506:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788796479.639509:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796479.639511:0:6707:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788796479.639513:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788796479.639515:0:6707:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788796479.639634:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788796479.639638:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796479.639640:0:6707:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788796479.639643:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788796479.639833:0:6689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788796479.639861:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788796479.639897:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe22461 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22468 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.639909:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe22461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22468 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796479.639917:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd2467d7000 from 1 10000000:01000000:0.0:1788796479.639920:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788796479.639959:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe2247d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.639967:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe2247d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.639979:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe2247d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796479.640004:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c621880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959253504:0@lo:101: 00000100:00100000:0.0:1788796479.640100:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796479.640149:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26737ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788796479.640433:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959253504 00000100:00100000:3.0:1788796479.640443:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959253504 00000100:00100000:3.0:1788796479.640497:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788796479.640507:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+11:6689:x1875688959253504:12345-0@lo:101: 00010000:00010000:3.0:1788796479.640520:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796479.640532:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2821d4800/0xdd273c88cfe22484 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2247d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796479.640634:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2821d4800/0xdd273c88cfe22484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2247d expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796479.640645:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2821d4800/0xdd273c88cfe22484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2247d expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796479.640654:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d4800, rc 0) 00000100:00100000:3.0:1788796479.640709:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:6689:x1875688959253504:12345-0@lo:101: Request processed in 203us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796479.640714:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788796479.640918:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c621880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959253504:0@lo:101: 00010000:00010000:1.0:1788796479.640934:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe2247d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22484 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.640943:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe2247d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22484 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796479.641061:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959253632:0@lo:501: 00000100:00100000:1.0:1788796479.641092:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796479.641271:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959253632 00000100:00100000:3.0:1788796479.641277:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959253632 00000100:00100000:3.0:1788796479.643410:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788796479.643427:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:6689:x1875688959253632:12345-0@lo:501: 00000100:00100000:3.0:1788796479.644828:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:6689:x1875688959253632:12345-0@lo:501: Request processed in 1403us (3730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796479.644839:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788796479.645067:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247cc7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788796479.645094:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959253632:0@lo:501: 00000100:00100000:1.0:1788796479.645648:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959253760:0@lo:503: 00000100:00100000:1.0:1788796479.645701:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796479.645736:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247cc7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788796479.645873:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959253760 00000100:00100000:2.0:1788796479.645882:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959253760 00000100:00100000:2.0:1788796479.645993:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788796479.646002:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+12:6689:x1875688959253760:12345-0@lo:503: 00000100:00100000:2.0:1788796479.646826:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+12:6689:x1875688959253760:12345-0@lo:503: Request processed in 822us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796479.646834:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788796479.647071:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959253760:0@lo:503: 00000040:00080000:1.0:1788796479.647510:0:6689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788796479.648489:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959253888:0@lo:502: 00000100:00100000:1.0:1788796479.648832:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796479.648878:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247cc7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788796479.649009:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959253888 00000100:00100000:3.0:1788796479.649018:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959253888 00000100:00100000:3.0:1788796479.649072:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788796479.649082:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:6689:x1875688959253888:12345-0@lo:502: 00000100:00100000:3.0:1788796479.649878:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:6689:x1875688959253888:12345-0@lo:502: Request processed in 796us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796479.650053:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959253888:0@lo:502: 00000040:00080000:1.0:1788796479.650476:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788796479.650530:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788796479.650971:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788796479.651297:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959254016:0@lo:502: 00000100:00100000:1.0:1788796479.651353:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796479.651392:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247cc7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788796479.651644:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959254016 00000100:00100000:3.0:1788796479.651653:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959254016 00000100:00100000:3.0:1788796479.651729:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788796479.651738:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:6689:x1875688959254016:12345-0@lo:502: 00000100:00100000:3.0:1788796479.651962:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:6689:x1875688959254016:12345-0@lo:502: Request processed in 225us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796479.651969:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788796479.652077:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959254016:0@lo:502: 00000040:00080000:1.0:1788796479.652214:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788796479.652227:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788796479.656996:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796479.657009:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796479.657012:0:6711:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788796479.657018:0:6711:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd2467d7000 00000020:00000080:3.0:1788796479.657020:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788796479.657052:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796479.657056:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796479.657057:0:6711:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788796479.657072:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788796479.657326:0:6689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788796479.657349:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788796479.657405:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe2247d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22484 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.657418:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe2247d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22484 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796479.657457:0:6689:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788796479.657460:0:6689:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd2467d7000 10000000:01000000:1.0:1788796479.657463:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd2467d7000 10000000:01000000:1.0:1788796479.657467:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788796479.657472:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd2467d7000 from 1 10000000:01000000:1.0:1788796479.657474:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788796479.657511:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd282053400/0xdd273c88cfe2248b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.657520:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd282053400/0xdd273c88cfe2248b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.657609:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd282053400/0xdd273c88cfe2248b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796479.657634:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959254144:0@lo:101: 00000100:00100000:1.0:1788796479.657694:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796479.657732:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247cc7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796479.657846:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959254144 00000100:00100000:3.0:1788796479.657853:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959254144 00000100:00100000:3.0:1788796479.657903:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788796479.657912:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:6689:x1875688959254144:12345-0@lo:101: 00010000:00010000:3.0:1788796479.657925:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796479.657937:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22492 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2248b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796479.657959:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2248b expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796479.657968:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2248b expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796479.657976:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5200, rc 0) 00000100:00100000:3.0:1788796479.658020:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:6689:x1875688959254144:12345-0@lo:101: Request processed in 108us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796479.658026:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788796479.658299:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959254144:0@lo:101: 00010000:00010000:1.0:1788796479.658313:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd282053400/0xdd273c88cfe2248b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22492 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796479.658322:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd282053400/0xdd273c88cfe2248b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22492 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796479.658408:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959254272:0@lo:501: 00000100:00100000:1.0:1788796479.658432:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796479.658454:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247cc7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796479.658494:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959254272 00000100:00100000:3.0:1788796479.658498:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959254272 00000100:00100000:3.0:1788796479.658558:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788796479.658565:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+13:6689:x1875688959254272:12345-0@lo:501: 00000100:00100000:3.0:1788796479.658797:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+13:6689:x1875688959254272:12345-0@lo:501: Request processed in 231us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796479.658803:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788796479.658926:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959254272:0@lo:501: 00000100:00100000:2.0:1788796479.658952:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959254400:0@lo:503: 00000100:00100000:2.0:1788796479.658986:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796479.659348:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a833c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796479.659399:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959254400 00000100:00100000:1.0:1788796479.659404:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959254400 00000100:00100000:1.0:1788796479.659428:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788796479.659433:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:6689:x1875688959254400:12345-0@lo:503: 00000100:00100000:1.0:1788796479.659592:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:6689:x1875688959254400:12345-0@lo:503: Request processed in 157us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796479.659599:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788796479.659736:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959254400:0@lo:503: 00000040:00080000:2.0:1788796479.660096:0:6689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788796479.660169:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959254528:0@lo:502: 00000100:00100000:2.0:1788796479.660215:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796479.660234:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a833c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796479.660471:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959254528 00000100:00100000:1.0:1788796479.660476:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959254528 00000100:00100000:1.0:1788796479.660495:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788796479.660501:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:6689:x1875688959254528:12345-0@lo:502: 00000100:00100000:1.0:1788796479.660798:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:6689:x1875688959254528:12345-0@lo:502: Request processed in 295us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796479.660804:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788796479.660900:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959254528:0@lo:502: 00000040:00080000:2.0:1788796479.661334:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788796479.661385:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788796479.661420:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788796479.661465:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788796479.661502:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788796479.661640:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788796479.661678:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788796479.661713:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788796479.661793:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788796479.661829:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788796479.661861:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788796479.661978:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788796479.662030:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788796479.662078:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788796479.662254:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788796479.662299:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788796479.662334:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788796479.662382:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788796479.662416:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788796479.662449:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788796479.662494:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788796479.662529:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788796479.662860:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788796479.662993:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788796479.663033:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788796479.663083:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788796479.663272:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788796479.663329:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788796479.663378:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959254656:0@lo:502: 00000100:00100000:2.0:1788796479.663448:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796479.663534:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a833c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796479.663724:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959254656 00000100:00100000:0.0:1788796479.663732:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959254656 00000100:00100000:1.0:1788796479.666666:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788796479.666690:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:6689:x1875688959254656:12345-0@lo:502: 00000100:00100000:1.0:1788796479.667289:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:6689:x1875688959254656:12345-0@lo:502: Request processed in 609us (3839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796479.667298:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788796479.667417:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959254656:0@lo:502: 00000040:00080000:2.0:1788796479.667534:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788796479.667627:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788796479.668561:0:6712:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788796479.668588:0:6712:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bd267694d28) 00000020:00000080:2.0:1788796479.668609:0:6712:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788796479.668697:0:6712:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd2467d7000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788796479.668701:0:6712:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd2467d7000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788796479.668704:0:6712:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd2467d7000 3 00010000:00080000:2.0:1788796479.668737:0:6712:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd26769f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.125@tcp at head 00010000:00010000:2.0:1788796479.671451:0:6712:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788796479.671802:0:6712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788796479.671839:0:6712:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788796479.671852:0:6712:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdd273c88cfe224a0 00000100:00080000:2.0:1788796479.671861:0:6712:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788796479.671874:0:6712:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bd26769f800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1788796479.672004:0:6712:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27b4fb800 x1875688959254784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788796479.672073:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875688959254784:0@lo:38: 00000100:00100000:3.0:1788796479.672150:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788796479.672339:0:6712:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788796479.672404:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959254912:0@lo:400: 00000100:00100000:2.0:1788796479.672433:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796479.672474:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959254784 00000100:00100000:2.0:1788796479.672481:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959254784 00000100:00100000:2.0:1788796479.672506:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959254912 00000100:00100000:2.0:1788796479.672515:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959254912 00000100:00100000:2.0:1788796479.672553:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788796479.672562:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959254912:12345-0@lo:400: 00000100:00100000:2.0:1788796479.672616:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959254912:12345-0@lo:400: Request processed in 55us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796479.672622:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788796479.672636:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788796479.672640:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875688959254784:12345-0@lo:38: 00010000:00080000:2.0:1788796479.672658:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1788796479.672702:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdd273c88cfe224a7 00000004:00100000:2.0:1788796479.672717:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788796479.672766:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9bd26769d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788796479.677173:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875688959254784:12345-0@lo:38: Request processed in 4521us (5012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796479.677301:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788796479.677360:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd27b4f8380 x1875688959254912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796479.677375:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959254912:0@lo:400: 00010000:00080000:3.0:1788796479.679692:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd27b4fb800 x1875688959254784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788796489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796479.679707:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788796479.679716:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788796479.679725:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788796479.679730:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788796479.679733:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd26769f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788796479.679739:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875688959254784:0@lo:38: 00000040:00080000:1.0:1788796479.681283:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788796479.684831:0:6689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788796479.684871:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788796479.684901:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd282053400/0xdd273c88cfe2248b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22492 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.684913:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd282053400/0xdd273c88cfe2248b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22492 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788796479.684970:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788796479.684977:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788796479.684978:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788796479.684979:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788796479.684981:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788796479.684982:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788796479.684983:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788796479.684984:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788796479.684986:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788796479.684987:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788796479.684988:0:6689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788796479.684992:0:6689:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788796479.684994:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788796479.684994:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788796479.684995:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788796479.684996:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788796479.684997:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788796479.684998:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788796479.684999:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788796479.684999:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788796479.685000:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788796479.685001:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788796479.685002:0:6689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788796479.685031:0:6689:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788796479.685064:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959255040:0@lo:253: 00000100:00100000:0.0:1788796479.685147:0:6689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796479.685389:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959255040 00000100:00100000:1.0:1788796479.685397:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959255040 00000100:00100000:1.0:1788796479.685443:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788796479.685451:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:6689:x1875688959255040:12345-0@lo:253: 20000000:01000000:1.0:1788796479.685477:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788796479.685492:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788796479.688777:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26737e900 going to sleep for 11 seconds 20000000:01000000:1.0:1788796479.722827:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788796479.722849:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788796479.724731:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788796479.724741:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788796479.724793:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe224ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.724812:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd282052a00/0xdd273c88cfe2240d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22406 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.724821:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe224ae lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.724873:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd282052a00/0xdd273c88cfe2240d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe22406 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796479.724899:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd282052a00/0xdd273c88cfe2240d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe22406 expref: 13 pid: 5838 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796479.724914:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875688959255168:0@lo:104: 00000100:00100000:2.0:1788796479.724973:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796479.725015:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd252760c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796479.725136:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959255168 00000100:00100000:3.0:1788796479.725145:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959255168 00000100:00100000:3.0:1788796479.725516:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788796479.725527:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f7145a2-0840-45a5-acde-da959fc7802f+3:5860:x1875688959255168:12345-0@lo:104: 00010000:00010000:3.0:1788796479.725548:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe22406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe2240d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796479.725603:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788796479.725609:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f7145a2-0840-45a5-acde-da959fc7802f+3:5860:x1875688959255168:12345-0@lo:104: Request processed in 86us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796479.725615:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788796479.727012:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796479.727023:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe22406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe2240d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.727033:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4a00 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796479.727037:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe22406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe2240d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.727056:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe22406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe2240d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796479.727080:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe22406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe2240d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796479.727086:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796479.727131:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe22406 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe2240d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.727138:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796479.727157:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe22406 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe2240d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.727164:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe22406 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe2240d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.727180:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796479.727324:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796479.727328:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796479.727362:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875688959255168:0@lo:104: 00010000:00010000:0.0:1788796479.727380:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe224ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796479.729701:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959255296:0@lo:103: 00000100:00100000:2.0:1788796479.729793:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796479.729907:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959255296 00000100:00100000:0.0:1788796479.729915:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959255296 00010000:00010000:0.0:1788796479.729945:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd282052a00/0xdd273c88cfe2240d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22406 expref: 14 pid: 5838 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796479.729984:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788796479.729992:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd246769050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+14:3305:x1875688959255296:12345-0@lo:103: 00010000:00010000:0.0:1788796479.730004:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796479.730022:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd282052a00/0xdd273c88cfe2240d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22406 expref: 14 pid: 5838 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.730034:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd282052a00/0xdd273c88cfe2240d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe22406 expref: 14 pid: 5838 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.730062:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd282052a00/0xdd273c88cfe2240d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe22406 expref: 14 pid: 5838 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.730076:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe224ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.730084:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe224ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788796479.730102:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005362517s 00010000:00010000:0.0:1788796479.730107:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe224ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.730113:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe224ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.730319:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe224ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.730330:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe224ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.730337:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152fe00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796479.730341:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe224ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.730350:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe224ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.730374:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe224ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.730384:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796479.730424:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd246769050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+13:3305:x1875688959255296:12345-0@lo:103: Request processed in 432us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796479.730431:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788796479.730480:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe224ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.730489:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe224ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796479.730495:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe224ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796479.730642:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959255296:0@lo:103: 00000100:00100000:1.0:1788796479.730779:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:6689:x1875688959255040:12345-0@lo:253: Request processed in 45328us (45631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796479.730787:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788796479.730890:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:6689:1875688959255040:0@lo:253: 10000000:01000000:0.0:1788796479.730902:0:6689:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788796479.730905:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788796479.730906:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788796479.730908:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788796479.730909:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788796479.730911:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788796479.730912:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788796479.730913:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788796479.730915:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788796479.730916:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788796479.730918:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788796479.730919:0:6689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788796479.730928:0:6689:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788796479.737694:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788796479.738110:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788796479.738608:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788796479.738797:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788796479.739066:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788796479.740648:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788796479.742835:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1788796479.835455:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788796479.955529:0:6689:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788796479.955537:0:6689:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788796479.955567:0:6689:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788796479.955625:0:6689:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788796479.955639:0:6689:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788796479.955666:0:6689:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788796480.858526:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796481.882380:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788796481.950394:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788796481.950404:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd250afa000 from 21 10000000:01000000:1.0:1788796481.950410:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788796481.950468:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd282053a00/0xdd273c88cfe224b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796481.950481:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd282053a00/0xdd273c88cfe224b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796481.950508:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd282053a00/0xdd273c88cfe224b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796481.950531:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959255424:0@lo:101: 00000100:00100000:1.0:1788796481.950597:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796481.950649:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247cc73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796481.950700:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959255424 00000100:00100000:0.0:1788796481.950708:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959255424 00000100:00100000:0.0:1788796481.950786:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788796481.950797:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd249a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+12:5841:x1875688959255424:12345-0@lo:101: 00010000:00010000:0.0:1788796481.950810:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796481.950822:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd240030c00/0xdd273c88cfe224bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe224b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796481.950856:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd240030c00/0xdd273c88cfe224bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe224b5 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796481.950867:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd240030c00/0xdd273c88cfe224bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe224b5 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796481.950876:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240030c00, rc 0) 00000100:00100000:0.0:1788796481.950921:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd249a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+13:5841:x1875688959255424:12345-0@lo:101: Request processed in 126us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796481.950927:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788796481.951025:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959255424:0@lo:101: 00010000:00010000:2.0:1788796481.951041:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd282053a00/0xdd273c88cfe224b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe224bc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796481.951049:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd282053a00/0xdd273c88cfe224b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe224bc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796481.951116:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959255552:0@lo:501: 00000100:00100000:2.0:1788796481.951141:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796481.951173:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2673afcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796481.951443:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959255552 00000100:00100000:0.0:1788796481.951457:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959255552 00000100:00100000:0.0:1788796481.951490:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788796481.951497:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:5841:x1875688959255552:12345-0@lo:501: 00000100:00100000:0.0:1788796481.951903:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:5841:x1875688959255552:12345-0@lo:501: Request processed in 405us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796481.951910:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788796481.953090:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959255552:0@lo:501: 00000100:00100000:2.0:1788796481.953143:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959255680:0@lo:503: 00000100:00100000:2.0:1788796481.953213:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796481.953250:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2673afcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796481.953859:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959255680 00000100:00100000:0.0:1788796481.953867:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959255680 00000100:00100000:0.0:1788796481.953917:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788796481.953926:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:5841:x1875688959255680:12345-0@lo:503: 00000100:00100000:0.0:1788796481.955025:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:5841:x1875688959255680:12345-0@lo:503: Request processed in 1095us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796481.955036:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788796481.955237:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959255680:0@lo:503: 00000100:00100000:1.0:1788796481.955484:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:6797:1875688959255808:0@lo:502: 00000100:00100000:1.0:1788796481.955524:0:6797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796481.955552:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247cc7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788796481.955601:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959255808 00000100:00100000:0.0:1788796481.955606:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959255808 00000100:00100000:0.0:1788796481.955648:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788796481.955655:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:6797:x1875688959255808:12345-0@lo:502: 00000100:00100000:0.0:1788796481.956273:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:6797:x1875688959255808:12345-0@lo:502: Request processed in 616us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796481.956280:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788796481.956400:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:6797:1875688959255808:0@lo:502: 00000100:00100000:2.0:1788796481.956448:0:6797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:6797:1875688959255936:0@lo:502: 00000100:00100000:2.0:1788796481.956484:0:6797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796481.956516:0:6797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2673af540 going to sleep for 11 seconds 00000100:00100000:0.0:1788796481.957149:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959255936 00000100:00100000:0.0:1788796481.957158:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959255936 00000100:00100000:0.0:1788796481.957231:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788796481.957239:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+13:6797:x1875688959255936:12345-0@lo:502: 00000100:00100000:0.0:1788796481.957436:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+13:6797:x1875688959255936:12345-0@lo:502: Request processed in 198us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796481.957443:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788796481.957516:0:6797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:6797:1875688959255936:0@lo:502: 00000040:00080000:2.0:1788796481.957540:0:6797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788796481.969047:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788796481.969099:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788796481.969111:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd282053a00/0xdd273c88cfe224b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe224bc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796481.969124:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd282053a00/0xdd273c88cfe224b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe224bc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796481.969135:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788796481.969138:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd250afa000 from 4 10000000:01000000:1.0:1788796481.969141:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788796481.969185:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd282052e00/0xdd273c88cfe224c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796481.969193:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd282052e00/0xdd273c88cfe224c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796481.969204:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd282052e00/0xdd273c88cfe224c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796481.969241:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959256064:0@lo:101: 00000100:00100000:1.0:1788796481.969308:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796481.969364:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247cc7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788796481.969379:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959256064 00000100:00100000:2.0:1788796481.969388:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959256064 00000100:00100000:2.0:1788796481.969433:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788796481.969441:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+13:5841:x1875688959256064:12345-0@lo:101: 00010000:00010000:2.0:1788796481.969456:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796481.969469:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd24152f800/0xdd273c88cfe224ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe224c3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796481.969491:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd24152f800/0xdd273c88cfe224ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe224c3 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796481.969501:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd24152f800/0xdd273c88cfe224ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe224c3 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796481.969509:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd24152f800, rc 0) 00000100:00100000:2.0:1788796481.969559:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959256064:12345-0@lo:101: Request processed in 118us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796481.969565:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788796481.969650:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959256064:0@lo:101: 00010000:00010000:1.0:1788796481.969663:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd282052e00/0xdd273c88cfe224c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe224ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796481.969673:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd282052e00/0xdd273c88cfe224c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe224ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796481.969721:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959256192:0@lo:256: 00000100:00100000:1.0:1788796481.969778:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796481.969801:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247cc7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788796481.969890:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959256192 00000100:00100000:2.0:1788796481.969901:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959256192 00000100:00100000:2.0:1788796481.969925:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788796481.969931:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959256192:12345-0@lo:256: 20000000:01000000:2.0:1788796481.969944:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788796481.969961:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788796481.969964:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788796481.970054:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959256192:12345-0@lo:256: Request processed in 122us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796481.970060:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788796481.970089:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959256192:0@lo:256: 10000000:01000000:2.0:1788796481.970125:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788796481.970130:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd282052e00/0xdd273c88cfe224c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe224ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796481.970137:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd282052e00/0xdd273c88cfe224c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe224ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796481.970143:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788796481.970145:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788796481.970147:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788796481.970162:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e000/0xdd273c88cfe224d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796481.970168:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd24152e000/0xdd273c88cfe224d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796481.970174:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd24152e000/0xdd273c88cfe224d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796481.970185:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959256320:0@lo:101: 00000100:00100000:2.0:1788796481.970214:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796481.970225:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2673af6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796481.970235:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959256320 00000100:00100000:2.0:1788796481.970239:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959256320 00000100:00100000:2.0:1788796481.970253:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788796481.970258:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959256320:12345-0@lo:101: 00010000:00010000:2.0:1788796481.970265:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796481.970273:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe224d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe224d1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796481.970285:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe224d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe224d1 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796481.970306:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe224d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe224d1 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796481.970312:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd24152e400, rc 0) 00000100:00100000:2.0:1788796481.970336:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959256320:12345-0@lo:101: Request processed in 77us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796481.970342:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788796481.970367:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959256320:0@lo:101: 00010000:00010000:2.0:1788796481.970376:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd24152e000/0xdd273c88cfe224d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe224d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796481.970383:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd24152e000/0xdd273c88cfe224d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe224d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796481.970423:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959256448:0@lo:501: 00000100:00100000:2.0:1788796481.970453:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796481.970464:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2673af6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796481.970475:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959256448 00000100:00100000:2.0:1788796481.970478:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959256448 00000100:00100000:2.0:1788796481.970493:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788796481.970498:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959256448:12345-0@lo:501: 00000100:00100000:2.0:1788796481.970732:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959256448:12345-0@lo:501: Request processed in 233us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796481.970738:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788796481.970781:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959256448:0@lo:501: 00000100:00100000:2.0:1788796481.970803:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959256576:0@lo:503: 00000100:00100000:2.0:1788796481.970834:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796481.970848:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2673af6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796481.970859:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959256576 00000100:00100000:2.0:1788796481.970862:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959256576 00000100:00100000:2.0:1788796481.970878:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788796481.970884:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959256576:12345-0@lo:503: 00000100:00100000:2.0:1788796481.971158:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959256576:12345-0@lo:503: Request processed in 274us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796481.971165:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788796481.971195:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959256576:0@lo:503: 00000100:00100000:3.0:1788796481.974979:0:6798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:6798:1875688959256704:0@lo:502: 00000100:00100000:3.0:1788796481.975250:0:6798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796481.975297:0:6798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796481.975779:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959256704 00000100:00100000:0.0:1788796481.975788:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959256704 00000100:00100000:0.0:1788796481.975845:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788796481.975855:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+15:6798:x1875688959256704:12345-0@lo:502: 00000100:00100000:0.0:1788796481.976396:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+15:6798:x1875688959256704:12345-0@lo:502: Request processed in 540us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796481.976405:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788796481.976621:0:6798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:6798:1875688959256704:0@lo:502: 00000020:01000000:3.0:1788796481.976664:0:6798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788796481.976673:0:6798:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788796481.976680:0:6798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796481.976683:0:6798:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788796481.976695:0:6798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788796481.976699:0:6798:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.125@tcp to nid 0x20000c0a8c97d (192.168.201.125@tcp) 00000020:01000000:3.0:1788796481.976720:0:6798:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788796481.976724:0:6798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788796481.976765:0:6798:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bd27cfb99b8) 00000020:00000080:3.0:1788796481.976799:0:6798:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788796481.976806:0:6798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788796481.977845:0:6798:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788796481.977854:0:6798:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788796481.977864:0:6798:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd273c88cfe224e6 00010000:00080000:3.0:1788796481.978041:0:6798:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd250290800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:3.0:1788796481.978356:0:6798:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788796482.050274:0:6798:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788796482.050300:0:6798:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788796482.050867:0:6798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788796482.051025:0:6798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788796482.051075:0:6798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788796482.051131:0:6798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788796482.054050:0:6805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788796482.054058:0:6805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788796482.055333:0:6798:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788796482.055346:0:6798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788796482.055381:0:6798:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788796482.055402:0:6798:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd273c88cfe224ed 00000100:00080000:2.0:1788796482.055412:0:6798:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788796482.055429:0:6798:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd250290800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1788796482.055464:0:6798:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27b4f9f80 x1875688959256832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788796482.055524:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959256832:0@lo:8: 00000100:00100000:1.0:1788796482.055591:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788796482.056535:0:6798:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788796482.056620:0:6798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796482.056695:0:6798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796482.056698:0:6798:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788796482.056703:0:6798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796482.056706:0:6798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796482.056708:0:6798:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788796482.056711:0:6798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788796482.056713:0:6798:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788796482.056768:0:6798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:6798:1875688959256960:0@lo:502: 00000100:00100000:2.0:1788796482.056825:0:6798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796482.057814:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959257088:0@lo:400: 00000100:00100000:2.0:1788796482.057996:0:6798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27257c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788796482.058036:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959256832 00000100:00100000:2.0:1788796482.058044:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959256832 00000100:00100000:2.0:1788796482.058078:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788796482.058086:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875688959256832:12345-0@lo:8: 00010000:00080000:2.0:1788796482.058110:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:2.0:1788796482.058138:0:6691:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd273c88cfe224f4 00002000:00100000:2.0:1788796482.058175:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bd27ce2b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788796482.058180:0:6691:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788796482.058184:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788796482.058300:0:6691:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788796482.058451:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788796482.058476:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9bd27ce2a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788796482.058543:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875688959256832:12345-0@lo:8: Request processed in 457us (2952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796482.058558:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796482.058721:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796482.058769:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796482.058777:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959257216:0@lo:400: 00000100:00100000:3.0:1788796482.058800:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796482.059017:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959257088 00000100:00100000:0.0:1788796482.059024:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959257088 00000100:00100000:0.0:1788796482.059067:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959257216 00000100:00100000:0.0:1788796482.059070:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959257216 00000100:00100000:0.0:1788796482.059096:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788796482.059103:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959257088:12345-0@lo:400: 00000100:00100000:0.0:1788796482.059146:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959257088:12345-0@lo:400: Request processed in 43us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796482.059152:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788796482.059164:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788796482.059170:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959257216:12345-0@lo:400: 00000100:00100000:0.0:1788796482.059195:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959257216:12345-0@lo:400: Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796482.059199:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788796482.059215:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788796482.059245:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27ecb9f80 x1875688959257216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796482.059259:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959257216:0@lo:400: 00010000:00080000:0.0:1788796482.059269:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27ecb9180 x1875688959257088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796482.059291:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959257088:0@lo:400: 00010000:00080000:1.0:1788796482.059403:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27b4f9f80 x1875688959256832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788796492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796482.059411:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788796482.059419:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788796482.059426:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788796482.059431:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788796482.059433:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd250290800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788796482.059647:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959256960 00000100:00100000:2.0:1788796482.059652:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959256960 00000100:00100000:2.0:1788796482.059678:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788796482.059684:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24a490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+15:6798:x1875688959256960:12345-0@lo:502: 00000100:00100000:2.0:1788796482.059932:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24a490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+15:6798:x1875688959256960:12345-0@lo:502: Request processed in 247us (3106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796482.059939:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788796482.060021:0:6798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:6798:1875688959256960:0@lo:502: 00000020:01000000:2.0:1788796482.060049:0:6798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796482.060056:0:6798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796482.060058:0:6798:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788796482.060063:0:6798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788796482.060172:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788796482.060189:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788796482.060197:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e000/0xdd273c88cfe224d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe224d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796482.060208:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd24152e000/0xdd273c88cfe224d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe224d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796482.060217:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788796482.060220:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd26caa3370 from 1 10000000:01000000:2.0:1788796482.060222:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788796482.060247:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e600/0xdd273c88cfe224fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796482.060256:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd24152e600/0xdd273c88cfe224fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796482.060272:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd24152e600/0xdd273c88cfe224fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796482.060288:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959257344:0@lo:101: 00000100:00100000:2.0:1788796482.060318:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796482.060346:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27257c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788796482.060361:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959257344 00000100:00100000:2.0:1788796482.060365:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959257344 00000100:00100000:2.0:1788796482.060386:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788796482.060392:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24a493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959257344:12345-0@lo:101: 00010000:00010000:2.0:1788796482.060401:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796482.060413:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe22502 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe224fb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796482.060434:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe22502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe224fb expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796482.060444:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe22502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe224fb expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796482.060452:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd24152fe00, rc 0) 00000100:00100000:2.0:1788796482.060481:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24a493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959257344:12345-0@lo:101: Request processed in 89us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796482.060486:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788796482.060516:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959257344:0@lo:101: 00010000:00010000:2.0:1788796482.060528:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd24152e600/0xdd273c88cfe224fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22502 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796482.060546:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd24152e600/0xdd273c88cfe224fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22502 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796482.060583:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959257472:0@lo:501: 00000100:00100000:2.0:1788796482.060608:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796482.060621:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27257c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788796482.060631:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959257472 00000100:00100000:2.0:1788796482.060635:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959257472 00000100:00100000:2.0:1788796482.060653:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788796482.060658:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd272493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959257472:12345-0@lo:501: 00000100:00100000:2.0:1788796482.060871:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd272493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959257472:12345-0@lo:501: Request processed in 212us (262us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788796482.060878:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788796482.060906:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959257472:0@lo:501: 10000000:01000000:2.0:1788796482.060927:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788796482.060933:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e600/0xdd273c88cfe224fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22502 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796482.060940:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd24152e600/0xdd273c88cfe224fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22502 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788796482.061058:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788796482.061075:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959256832:0@lo:8: 00000004:00080000:2.0:1788796482.072803:0:6805:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788796482.075941:0:6805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 209057191471ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788796482.147985:0:6806:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788796482.148031:0:6806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6806:1875688959257728:0@lo:7: 00000100:00100000:1.0:1788796482.148097:0:6806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796482.148138:0:6806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788796482.148157:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959257600:0@lo:13: 00000100:00100000:1.0:1788796482.148178:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796482.149526:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959257600 00000100:00100000:0.0:1788796482.149542:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959257600 00000100:00100000:0.0:1788796482.149611:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796482.150140:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959257728 00000100:00100000:3.0:1788796482.150146:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959257728 00000100:00100000:3.0:1788796482.150174:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788796482.150182:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6806:x1875688959257728:12345-0@lo:7: 00000100:00100000:0.0:1788796482.150792:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875688959257600:12345-0@lo:13: 00002000:00000024:0.0:1788796482.150817:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788796482.151497:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875688959257600:12345-0@lo:13: Request processed in 1875us (3314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796482.151508:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788796482.151542:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788796482.152796:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd25030c380 x1875688959257600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796482.152822:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959257600:0@lo:13: 00002000:00080000:3.0:1788796482.165452:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788796482.165460:0:6694:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788796482.165550:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6806:x1875688959257728:12345-0@lo:7: Request processed in 15365us (17449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796482.165566:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788796482.172597:0:6806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd25030f100 x1875688959257728/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788796498 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796482.172615:0:6806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6806:1875688959257728:0@lo:7: 00000004:00080000:3.0:1788796482.172636:0:6806:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788796482.172672:0:6806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecbad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6806:1875688959257856:0@lo:5: 00000100:00100000:3.0:1788796482.172721:0:6806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796482.172782:0:6806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93480 going to sleep for 11 seconds 00000100:00100000:0.0:1788796482.173122:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959257856 00000100:00100000:0.0:1788796482.173130:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959257856 00000100:00100000:0.0:1788796482.173178:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788796482.173187:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6806:x1875688959257856:12345-0@lo:5: 00002000:00080000:0.0:1788796482.173222:0:6692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788796482.173226:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788796482.173549:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6806:x1875688959257856:12345-0@lo:5: Request processed in 363us (826us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788796482.173557:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788796482.174602:0:6806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27ecbad80 x1875688959257856/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788796498 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796482.174688:0:6806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecbad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6806:1875688959257856:0@lo:5: 00000004:00080000:3.0:1788796482.174702:0:6806:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788796482.174738:0:6806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecbaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6806:1875688959257984:0@lo:700: 00000100:00100000:3.0:1788796482.174815:0:6806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796482.175385:0:6806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93480 going to sleep for 11 seconds 00000100:00100000:3.0:1788796482.181326:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959257984 00000100:00100000:3.0:1788796482.181342:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959257984 00000100:00100000:3.0:1788796482.181397:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796482.181407:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6806:x1875688959257984:12345-0@lo:700: 00000100:00100000:3.0:1788796482.181466:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecba680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6700:1875688959258112:0@lo:700: 00000100:00100000:3.0:1788796482.181524:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796482.181560:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788796482.181694:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959258112 00000100:00100000:3.0:1788796482.181698:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959258112 00000100:00100000:3.0:1788796482.181734:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796482.181740:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6700:x1875688959258112:12345-0@lo:700: 00000004:00080000:1.0:1788796482.192772:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:3.0:1788796482.213582:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788796482.220243:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6700:x1875688959258112:12345-0@lo:700: Request processed in 38496us (38711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796482.220261:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788796482.220271:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27ecba680 x1875688959258112/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788796498 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796482.220355:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecba680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6700:1875688959258112:0@lo:700: 40000000:02000000:3.0:1788796482.220369:0:6700:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1788796482.291445:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788796482.291465:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788796482.291626:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6806:x1875688959257984:12345-0@lo:700: Request processed in 110217us (116807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796482.291642:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788796482.291727:0:6806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27ecbaa00 x1875688959257984/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788796498 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796482.291740:0:6806:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788796482.292288:0:6806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecbaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6806:1875688959257984:0@lo:700: 00000004:02000040:2.0:1788796482.343303:0:6806:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788796482.352424:0:6806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6806:1875688959258240:0@lo:5: 00000100:00100000:2.0:1788796482.352497:0:6806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796482.352557:0:6806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27257c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788796482.353776:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959258240 00000100:00100000:1.0:1788796482.353788:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959258240 00000100:00100000:1.0:1788796482.353849:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788796482.353859:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6806:x1875688959258240:12345-0@lo:5: 00002000:00080000:1.0:1788796482.366780:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788796482.366802:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788796482.371727:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6806:x1875688959258240:12345-0@lo:5: Request processed in 17862us (19222us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788796482.371739:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788796482.371816:0:6806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27b4fb480 x1875688959258240/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788796498 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796482.371834:0:6806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6806:1875688959258240:0@lo:5: 00000004:00080000:3.0:1788796482.371863:0:6806:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788796482.914996:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796483.936842:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796484.954293:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796485.980496:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796487.007740:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788796487.166594:0:7059:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788796487.515108:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796487.515134:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959258368:0@lo:13: 00000100:00100000:0.0:1788796487.515230:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796487.515291:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959258368 00000100:00100000:0.0:1788796487.515304:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959258368 00000100:00100000:0.0:1788796487.515358:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796487.515366:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875688959258368:12345-0@lo:13: 00002000:00000024:0.0:1788796487.515396:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796487.515439:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875688959258368:12345-0@lo:13: Request processed in 73us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796487.515446:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788796487.515466:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788796487.517152:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27b4fad80 x1875688959258368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796487.517182:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959258368:0@lo:13: 00000100:00100000:0.0:1788796487.539072:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959258624:0@lo:400: 00000100:00100000:0.0:1788796487.539148:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796487.539188:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788796487.539196:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959258496:0@lo:400: 00000100:00100000:0.0:1788796487.539223:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796487.539274:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959258624 00000100:00100000:0.0:1788796487.539283:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959258624 00000100:00100000:0.0:1788796487.539331:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788796487.539340:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959258624:12345-0@lo:400: 00000100:00100000:0.0:1788796487.539395:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959258624:12345-0@lo:400: Request processed in 56us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796487.539402:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788796487.539440:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd25030c700 x1875688959258624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796487.539454:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959258624:0@lo:400: 00000100:00100000:1.0:1788796487.541448:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788796487.541473:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959258752:0@lo:400: 00000100:00100000:1.0:1788796487.541537:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796487.542404:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959258752 00000100:00100000:0.0:1788796487.542416:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959258752 00000100:00100000:0.0:1788796487.542470:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788796487.542479:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959258752:12345-0@lo:400: 00000100:00100000:2.0:1788796487.542543:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959258496 00000100:00100000:2.0:1788796487.542547:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959258496 00000100:00100000:0.0:1788796487.542564:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959258752:12345-0@lo:400: Request processed in 87us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796487.542571:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788796487.542574:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788796487.542579:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd272492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:3307:x1875688959258496:12345-0@lo:400: 00000100:00080000:0.0:1788796487.542590:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796487.542632:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd272492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:3307:x1875688959258496:12345-0@lo:400: Request processed in 52us (3407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796487.542637:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788796487.542718:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959258496:0@lo:400: 00010000:00080000:1.0:1788796487.542840:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd25030ea00 x1875688959258752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796487.542852:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959258752:0@lo:400: 00000001:00080000:3.0:1788796487.615020:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788796488.027949:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796489.050017:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796490.075320:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796491.099580:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796492.131759:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796492.635450:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959259008:0@lo:400: 00000100:00100000:3.0:1788796492.635526:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796492.635599:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959259008 00000100:00100000:3.0:1788796492.635607:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959259008 00000100:00100000:3.0:1788796492.635651:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788796492.635659:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959259008:12345-0@lo:400: 00000100:00100000:3.0:1788796492.635718:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959259008:12345-0@lo:400: Request processed in 58us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796492.635725:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788796492.635807:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27ecb9500 x1875688959259008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796492.635832:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959259008:0@lo:400: 00000100:00100000:3.0:1788796492.635868:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875688959259136:0@lo:400: 00000100:00100000:3.0:1788796492.635895:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796492.636069:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959258880:0@lo:400: 00000100:00100000:1.0:1788796492.636106:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796492.636163:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959258880 00000100:00100000:1.0:1788796492.636170:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959258880 00000100:00100000:1.0:1788796492.636200:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788796492.636207:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd272491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+16:3305:x1875688959258880:12345-0@lo:400: 00000100:00100000:1.0:1788796492.636247:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd272491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+16:3305:x1875688959258880:12345-0@lo:400: Request processed in 39us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796492.636254:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788796492.636376:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959258880:0@lo:400: 00000100:00100000:3.0:1788796492.637345:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959259264:0@lo:400: 00000100:00100000:3.0:1788796492.637384:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796492.637417:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959259264 00000100:00100000:3.0:1788796492.637423:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959259264 00000100:00100000:3.0:1788796492.637466:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796492.637474:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959259264:12345-0@lo:400: 00000100:00100000:3.0:1788796492.637517:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959259264:12345-0@lo:400: Request processed in 43us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796492.637523:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788796492.637540:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788796492.637562:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27ecbad80 x1875688959259264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796492.637572:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788796492.637585:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959259264:0@lo:400: 00000100:00100000:1.0:1788796492.637737:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959259136 00000100:00100000:1.0:1788796492.637761:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959259136 00000100:00100000:1.0:1788796492.637791:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788796492.637797:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875688959259136:12345-0@lo:400: 00000100:00100000:1.0:1788796492.637846:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875688959259136:12345-0@lo:400: Request processed in 49us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796492.637852:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788796492.639161:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788796492.639204:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27ecb9500 x1875688959259136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796492.639218:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875688959259136:0@lo:400: 00000100:00100000:3.0:1788796492.648360:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959259392:0@lo:13: 00000100:00100000:3.0:1788796492.648435:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796492.649066:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959259392 00000100:00100000:1.0:1788796492.649077:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959259392 00000100:00100000:1.0:1788796492.649148:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788796492.649161:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959259392:12345-0@lo:13: 00002000:00000024:1.0:1788796492.649199:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796492.649261:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959259392:12345-0@lo:13: Request processed in 103us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796492.649279:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788796492.649367:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd25030ea00 x1875688959259392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796492.649388:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959259392:0@lo:13: 00010000:00010000:1.0:1788796493.148739:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796494.171275:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796495.193935:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796496.218140:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796497.244926:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796497.756973:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959259648:0@lo:400: 00000100:00100000:3.0:1788796497.757046:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796497.757101:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788796497.757108:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959259520:0@lo:400: 00000100:00100000:3.0:1788796497.757136:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796497.757166:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959259776:0@lo:400: 00000100:00100000:3.0:1788796497.757188:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796497.757206:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788796497.757212:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959259904:0@lo:400: 00000100:00100000:3.0:1788796497.757241:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796497.757273:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959259648 00000100:00100000:3.0:1788796497.757280:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959259648 00000100:00100000:3.0:1788796497.758005:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959259776 00000100:00100000:3.0:1788796497.758012:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959259776 00000100:00100000:3.0:1788796497.758047:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788796497.758056:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959259648:12345-0@lo:400: 00000100:00100000:3.0:1788796497.758119:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959259648:12345-0@lo:400: Request processed in 63us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796497.758126:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788796497.758143:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788796497.758150:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959259776:12345-0@lo:400: 00000100:00100000:3.0:1788796497.758182:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959259776:12345-0@lo:400: Request processed in 33us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796497.758202:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788796497.758224:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959259520 00000100:00100000:3.0:1788796497.758228:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959259520 00000100:00100000:3.0:1788796497.758262:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788796497.758268:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+16:3307:x1875688959259520:12345-0@lo:400: 00000100:00100000:3.0:1788796497.758296:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+16:3307:x1875688959259520:12345-0@lo:400: Request processed in 29us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796497.758301:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788796497.759696:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959259904 00000100:00100000:3.0:1788796497.759709:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959259904 00000100:00100000:3.0:1788796497.759790:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788796497.760155:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959259904:12345-0@lo:400: 00000100:00100000:3.0:1788796497.760474:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959259904:12345-0@lo:400: Request processed in 674us (3230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796497.760482:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788796497.760511:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788796497.760516:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788796497.760552:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27ecb8a80 x1875688959259904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796497.760795:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959259520:0@lo:400: 00010000:00080000:2.0:1788796497.760830:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27ecb9f80 x1875688959259648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796497.760840:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959259648:0@lo:400: 00000100:00100000:3.0:1788796497.761064:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959259904:0@lo:400: 00010000:00080000:3.0:1788796497.761083:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27ecb8380 x1875688959259776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796497.761092:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959259776:0@lo:400: 00000100:00100000:0.0:1788796497.761743:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959260032:0@lo:13: 00000100:00100000:0.0:1788796497.761977:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796497.762060:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959260032 00000100:00100000:2.0:1788796497.762067:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959260032 00000100:00100000:2.0:1788796497.762114:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788796497.762137:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c622300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959260032:12345-0@lo:13: 00002000:00000024:2.0:1788796497.762171:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796497.762659:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c622300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959260032:12345-0@lo:13: Request processed in 523us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796497.762667:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788796497.762736:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd25030df80 x1875688959260032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796497.763171:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959260032:0@lo:13: 00010000:00010000:1.0:1788796498.268944:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796499.292420:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788796499.940616:0:7632:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788796499.940620:0:7632:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788796499.940812:0:7632:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd26717e800 00000020:01000004:3.0:1788796499.940834:0:7632:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788796499.940847:0:7632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788796499.940861:0:7632:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bd27cfb8000) 00000020:00000080:3.0:1788796499.940878:0:7632:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788796499.955286:0:7632:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788796499.955631:0:7632:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788796499.975423:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788796499.980510:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788796499.980629:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788796499.980700:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788796499.980729:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788796499.981170:0:7632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788796499.981182:0:7632:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788796499.981191:0:7632:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdd273c88cfe22510 00000020:01000004:3.0:1788796499.981199:0:7632:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788796499.981217:0:7632:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.125@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788796499.981221:0:7632:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788796499.981226:0:7632:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788796499.981247:0:7632:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788796499.981251:0:7632:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788796499.999311:0:7632:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788796499.999356:0:7632:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.125@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788796499.999360:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788796499.999362:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788796499.999363:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796499.999365:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796499.999366:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796499.999367:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796499.999368:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788796499.999369:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788796499.999371:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788796499.999372:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796499.999373:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788796499.999377:0:7632:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788796499.999380:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788796499.999381:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788796499.999382:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796499.999383:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796499.999384:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796499.999386:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796499.999387:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788796499.999387:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788796499.999389:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788796499.999390:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796499.999391:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788796499.999418:0:7632:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788796499.999440:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959260160:0@lo:253: 00000100:00100000:2.0:1788796499.999513:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796499.999722:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26c676f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796499.999894:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959260160 00000100:00100000:3.0:1788796499.999902:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959260160 00000100:00100000:3.0:1788796499.999996:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788796500.000006:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:7632:x1875688959260160:12345-0@lo:253: 20000000:01000000:3.0:1788796500.000037:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788796500.000206:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788796500.000214:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788796500.000219:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788796500.001675:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788796500.002016:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788796500.002032:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788796500.002210:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788796500.002220:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788796500.002254:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788796500.002309:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788796500.002874:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788796500.002896:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.125@tcp 20000000:01000000:3.0:1788796500.002898:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.125@tcp (null) (null) (null) 00000040:00080000:3.0:1788796500.002936:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788796500.002945:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788796500.002997:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788796500.003006:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.125@tcp (null) (null) 00000040:00080000:3.0:1788796500.003197:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788796500.003210:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788796500.003246:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788796500.003313:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788796500.004396:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788796500.004422:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.125@tcp 20000000:01000000:3.0:1788796500.004424:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.125@tcp (null) (null) (null) 00000040:00080000:3.0:1788796500.004463:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788796500.004471:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788796500.004504:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788796500.004513:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.125@tcp (null) (null) 00000040:00080000:3.0:1788796500.004626:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788796500.004637:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788796500.004697:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788796500.004788:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788796500.004807:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1788796500.004810:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1788796500.004817:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788796500.004818:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788796500.004820:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788796500.004839:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788796500.004842:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788796500.004877:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788796500.004879:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788796500.005597:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788796500.005652:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788796500.005716:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788796500.006181:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788796500.006223:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788796500.006282:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788796500.006294:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788796500.006296:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788796500.007034:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788796500.007409:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788796500.007454:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788796500.007521:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788796500.007612:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788796500.007614:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788796500.008378:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788796500.008444:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788796500.008503:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788796500.008944:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788796500.009005:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788796500.009197:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788796500.009213:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788796500.009216:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788796500.010327:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788796500.010421:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788796500.010458:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788796500.014475:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788796500.014663:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788796500.015009:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1788796500.015051:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788796500.015074:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe22517 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.015265:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd24152e800/0xdd273c88cfe22468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22461 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.015276:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22492 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2248b expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.015284:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd240030c00/0xdd273c88cfe224bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe224b5 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.015292:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe224d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe224d1 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.015299:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe22502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe224fb expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.015306:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe22517 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.015353:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe22502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe224fb expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.015368:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe22502 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe224fb expref: 16 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796500.015398:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959260288:0@lo:104: 00000100:00100000:2.0:1788796500.015479:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796500.015629:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788796500.015646:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959260288 00000100:00100000:3.0:1788796500.015654:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959260288 00000100:00100000:3.0:1788796500.015723:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788796500.015733:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27249dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f7145a2-0840-45a5-acde-da959fc7802f+3:5839:x1875688959260288:12345-0@lo:104: 00010000:00010000:3.0:1788796500.015769:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd24152e600/0xdd273c88cfe224fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22502 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796500.015824:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788796500.015830:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27249dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f7145a2-0840-45a5-acde-da959fc7802f+3:5839:x1875688959260288:12345-0@lo:104: Request processed in 100us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796500.015837:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788796500.015991:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe224d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe224d1 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.016000:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe224d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe224d1 expref: 16 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796500.016010:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959260416:0@lo:104: 00000100:00100000:2.0:1788796500.016035:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788796500.016215:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796500.016224:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd24152e600/0xdd273c88cfe224fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22502 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.016233:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152e600 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796500.016237:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152e600/0xdd273c88cfe224fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe22502 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.016246:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd24152e600/0xdd273c88cfe224fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe22502 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796500.016253:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152e600/0xdd273c88cfe224fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe22502 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796500.016272:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796500.016316:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd24152e600/0xdd273c88cfe224fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22502 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.016323:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796500.016341:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd24152e600/0xdd273c88cfe224fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22502 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.016350:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd24152e600/0xdd273c88cfe224fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22502 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.016365:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796500.016367:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796500.016369:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796500.016394:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959260544:0@lo:103: 00000100:00100000:0.0:1788796500.016434:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.016489:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959260544 00000100:00100000:0.0:1788796500.016495:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959260544 00010000:00010000:0.0:1788796500.016519:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe22502 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe224fb expref: 17 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796500.016558:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788796500.016567:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+17:3307:x1875688959260544:12345-0@lo:103: 00010000:00010000:0.0:1788796500.016578:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796500.016584:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe22502 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe224fb expref: 17 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.016594:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe22502 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe224fb expref: 17 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.016618:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796500.016649:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+17:3307:x1875688959260544:12345-0@lo:103: Request processed in 83us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.016656:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788796500.016706:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959260544:0@lo:103: 00010000:00010000:2.0:1788796500.016931:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd240030c00/0xdd273c88cfe224bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe224b5 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.016954:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd240030c00/0xdd273c88cfe224bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe224b5 expref: 16 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796500.016964:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959260672:0@lo:104: 00000100:00100000:2.0:1788796500.016989:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788796500.017112:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe2248b expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.017121:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22492 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe2248b expref: 16 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796500.017130:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959260800:0@lo:104: 00000100:00100000:2.0:1788796500.017150:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788796500.017503:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd24152e800/0xdd273c88cfe22468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe22461 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.017523:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bd24152e800/0xdd273c88cfe22468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe22461 expref: 16 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796500.017532:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fbb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959260928:0@lo:104: 00000100:00100000:2.0:1788796500.017624:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.017654:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959260416 00000100:00100000:0.0:1788796500.017661:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959260416 00000100:00100000:0.0:1788796500.017696:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959260672 00000100:00100000:0.0:1788796500.017699:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959260672 00000100:00100000:0.0:1788796500.017713:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959260800 00000100:00100000:0.0:1788796500.017716:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959260800 00000100:00100000:0.0:1788796500.017729:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788796500.017736:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+5:5839:x1875688959260416:12345-0@lo:104: 00010000:00010000:0.0:1788796500.017782:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd24152e000/0xdd273c88cfe224d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe224d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.017828:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788796500.017834:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+5:5839:x1875688959260416:12345-0@lo:104: Request processed in 99us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.017840:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788796500.017855:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788796500.017861:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+4:5839:x1875688959260672:12345-0@lo:104: 00010000:00010000:0.0:1788796500.017868:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd282053a00/0xdd273c88cfe224b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe224bc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.017900:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788796500.017905:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+4:5839:x1875688959260672:12345-0@lo:104: Request processed in 46us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.017925:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788796500.017938:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788796500.017944:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:5839:x1875688959260800:12345-0@lo:104: 00010000:00010000:0.0:1788796500.017952:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd282053400/0xdd273c88cfe2248b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22492 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.017980:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788796500.017985:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:5839:x1875688959260800:12345-0@lo:104: Request processed in 42us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.017990:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788796500.018007:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788796500.018012:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd24152e000/0xdd273c88cfe224d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe224d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018019:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152e000 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796500.018023:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152e000/0xdd273c88cfe224d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe224d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018031:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd24152e000/0xdd273c88cfe224d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe224d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796500.018038:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152e000/0xdd273c88cfe224d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe224d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796500.018055:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796500.018079:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd24152e000/0xdd273c88cfe224d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe224d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018094:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796500.018119:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd24152e000/0xdd273c88cfe224d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe224d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018126:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd24152e000/0xdd273c88cfe224d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe224d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018139:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788796500.018143:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd282053a00/0xdd273c88cfe224b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe224bc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018148:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd282053a00 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796500.018151:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd282053a00/0xdd273c88cfe224b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe224bc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018158:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd282053a00/0xdd273c88cfe224b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe224bc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796500.018164:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd282053a00/0xdd273c88cfe224b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe224bc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796500.018169:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796500.018181:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd282053a00/0xdd273c88cfe224b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe224bc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018187:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796500.018192:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd282053a00/0xdd273c88cfe224b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe224bc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018197:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd282053a00/0xdd273c88cfe224b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe224bc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018205:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796500.018214:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd282053400/0xdd273c88cfe2248b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22492 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018220:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd282053400 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796500.018223:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd282053400/0xdd273c88cfe2248b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe22492 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018230:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd282053400/0xdd273c88cfe2248b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe22492 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796500.018236:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd282053400/0xdd273c88cfe2248b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe22492 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796500.018241:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796500.018255:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd282053400/0xdd273c88cfe2248b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22492 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018260:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796500.018274:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd282053400/0xdd273c88cfe2248b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22492 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018282:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd282053400/0xdd273c88cfe2248b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22492 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018291:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796500.018293:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796500.018295:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796500.018307:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959261056:0@lo:103: 00000100:00100000:0.0:1788796500.018334:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.018359:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796500.018365:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959261184:0@lo:103: 00000100:00100000:0.0:1788796500.018394:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.018423:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959261056 00000100:00100000:0.0:1788796500.018428:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959261056 00010000:00010000:0.0:1788796500.018447:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe224d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe224d1 expref: 17 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796500.018467:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959261184 00000100:00100000:0.0:1788796500.018470:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959261184 00010000:00010000:0.0:1788796500.018479:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd240030c00/0xdd273c88cfe224bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe224b5 expref: 18 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796500.018491:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788796500.018497:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c621c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+18:3304:x1875688959261056:12345-0@lo:103: 00010000:00010000:0.0:1788796500.018506:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796500.018511:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe224d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe224d1 expref: 18 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018521:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe224d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe224d1 expref: 18 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018548:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796500.018576:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c621c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+18:3304:x1875688959261056:12345-0@lo:103: Request processed in 79us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.018582:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788796500.018596:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788796500.018601:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c623800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+17:3304:x1875688959261184:12345-0@lo:103: 00010000:00010000:0.0:1788796500.018608:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796500.018612:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd240030c00/0xdd273c88cfe224bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe224b5 expref: 17 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018631:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd240030c00/0xdd273c88cfe224bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe224b5 expref: 17 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018640:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796500.018664:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c623800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+17:3304:x1875688959261184:12345-0@lo:103: Request processed in 63us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.018670:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788796500.018702:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959261312:0@lo:103: 00000100:00100000:0.0:1788796500.018726:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.018780:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959261312 00000100:00100000:0.0:1788796500.018784:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959261312 00010000:00010000:0.0:1788796500.018796:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22492 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2248b expref: 17 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796500.018810:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788796500.018815:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f7145a2-0840-45a5-acde-da959fc7802f+17:3306:x1875688959261312:12345-0@lo:103: 00010000:00010000:0.0:1788796500.018822:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796500.018825:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22492 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2248b expref: 17 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018834:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22492 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe2248b expref: 17 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.018842:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796500.018868:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f7145a2-0840-45a5-acde-da959fc7802f+17:3306:x1875688959261312:12345-0@lo:103: Request processed in 53us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.018875:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788796500.018909:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959261312:0@lo:103: 00000100:00100000:0.0:1788796500.018943:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c620700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959261184:0@lo:103: 00000100:00100000:0.0:1788796500.018951:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959261056:0@lo:103: 00010000:00010000:1.0:1788796500.019315:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796500.019545:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26c676240 going to sleep for 11 seconds 00010000:00010000:2.0:1788796500.019563:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd24152fe00/0xdd273c88cfe22502 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe224fb expref: 16 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796500.019577:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959260288:0@lo:104: 00010000:00010000:2.0:1788796500.019588:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe224d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe224d1 expref: 15 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796500.019596:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959260416:0@lo:104: 00010000:00010000:2.0:1788796500.019605:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd240030c00/0xdd273c88cfe224bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe224b5 expref: 14 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796500.019615:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959260672:0@lo:104: 00010000:00010000:2.0:1788796500.019624:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22492 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe2248b expref: 13 pid: 5839 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796500.019633:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959260800:0@lo:104: 00000100:00100000:0.0:1788796500.022418:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959260928 00000100:00100000:0.0:1788796500.022434:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959260928 00000100:00100000:0.0:1788796500.022557:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788796500.022568:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:5839:x1875688959260928:12345-0@lo:104: 00010000:00010000:0.0:1788796500.022585:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe22461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22468 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.022698:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788796500.022705:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:5839:x1875688959260928:12345-0@lo:104: Request processed in 140us (5081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.022712:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788796500.022986:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fbb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1875688959260928:0@lo:104: 00010000:00010000:2.0:1788796500.023018:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe22517 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.023922:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796500.023931:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe22461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22468 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.023941:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152f600 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796500.023946:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe22461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe22468 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.023956:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe22461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe22468 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796500.023963:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe22461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe22468 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796500.023969:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796500.024157:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe22461 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22468 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.024164:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796500.024195:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe22461 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22468 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.024202:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe22461 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22468 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.024223:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796500.024225:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796500.024227:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796500.024235:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788796500.024258:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959261440:0@lo:103: 00000100:00100000:0.0:1788796500.024323:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.024377:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959261440 00000100:00100000:0.0:1788796500.024384:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959261440 00010000:00010000:0.0:1788796500.024412:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd24152e800/0xdd273c88cfe22468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22461 expref: 13 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796500.024442:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788796500.024451:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f7145a2-0840-45a5-acde-da959fc7802f+13:3306:x1875688959261440:12345-0@lo:103: 00010000:00010000:0.0:1788796500.024468:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796500.024473:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9bd24152e800/0xdd273c88cfe22468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22461 expref: 13 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.024488:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd24152e800/0xdd273c88cfe22468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe22461 expref: 13 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.024504:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd24152e800/0xdd273c88cfe22468 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe22461 expref: 13 pid: 5838 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.024647:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe22517 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.024658:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe22517 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.024675:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe22517 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.024682:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe22517 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.024699:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe22517 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.024705:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe22517 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.024710:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152fc00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796500.024715:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe22517 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.024722:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe22517 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.024992:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe22517 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.025002:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796500.025054:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f7145a2-0840-45a5-acde-da959fc7802f+12:3306:x1875688959261440:12345-0@lo:103: Request processed in 593us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.025073:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788796500.025121:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959261440:0@lo:103: 00010000:00010000:2.0:1788796500.025266:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe22517 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.025282:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe22517 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.025289:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe22517 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788796500.025306:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788796500.068768:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+11:7632:x1875688959260160:12345-0@lo:253: Request processed in 68729us (69220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796500.068784:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788796500.068898:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959260160:0@lo:253: 10000000:01000000:2.0:1788796500.068913:0:7632:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788796500.068917:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788796500.068918:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788796500.068920:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796500.068921:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788796500.068923:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796500.068924:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796500.068925:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788796500.068927:0:7632:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788796500.068928:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796500.068930:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788796500.068952:0:7632:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd26717e800 from lustre-OST0001 10000000:01000000:2.0:1788796500.068979:0:7632:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788796500.068982:0:7632:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788796500.068993:0:7632:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd26caa3370 local copy 10000000:01000000:2.0:1788796500.068998:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788796500.069034:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2251e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.069058:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2251e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.069068:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2251e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796500.069106:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959261568:0@lo:101: 00000100:00100000:2.0:1788796500.069142:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796500.069195:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26c676000 going to sleep for 11 seconds 00000100:00100000:0.0:1788796500.069347:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959261568 00000100:00100000:0.0:1788796500.069354:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959261568 00000100:00100000:0.0:1788796500.069397:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788796500.069406:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+11:7632:x1875688959261568:12345-0@lo:101: 00010000:00010000:0.0:1788796500.069419:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796500.069434:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22525 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2251e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.069457:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2251e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.069467:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2251e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.069477:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240030e00, rc 0) 00000100:00100000:0.0:1788796500.069518:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:7632:x1875688959261568:12345-0@lo:101: Request processed in 113us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.069524:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788796500.069615:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959261568:0@lo:101: 00010000:00010000:1.0:1788796500.069628:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2251e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdd273c88cfe22525 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796500.069637:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2251e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd273c88cfe22525 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796500.069829:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959261696:0@lo:501: 00000100:00100000:1.0:1788796500.069866:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796500.069886:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2467e3480 going to sleep for 11 seconds 00000100:00100000:0.0:1788796500.070003:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959261696 00000100:00100000:0.0:1788796500.070008:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959261696 00000100:00100000:0.0:1788796500.070050:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788796500.070058:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:7632:x1875688959261696:12345-0@lo:501: 00000100:00100000:0.0:1788796500.070257:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:7632:x1875688959261696:12345-0@lo:501: Request processed in 200us (390us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788796500.070265:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788796500.070306:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959261696:0@lo:501: 10000000:01000000:0.0:1788796500.070322:0:7632:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788796500.070346:0:7632:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788796500.070352:0:7632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2251e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdd273c88cfe22525 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.070359:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2251e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd273c88cfe22525 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.070366:0:7632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2251e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdd273c88cfe22525 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.070380:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788796500.070399:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd26717e800 10000000:01000000:0.0:1788796500.070403:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788796500.070407:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788796500.070410:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788796500.070415:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788796500.070417:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788796500.070435:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe2252c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.070442:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe2252c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.070451:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe2252c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796500.070463:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959261824:0@lo:101: 00000100:00100000:0.0:1788796500.070490:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.070512:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796500.070538:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959261824 00000100:00100000:0.0:1788796500.070543:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959261824 00000100:00100000:0.0:1788796500.070562:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788796500.070569:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:7632:x1875688959261824:12345-0@lo:101: 00010000:00010000:0.0:1788796500.070577:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796500.070586:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd240030200/0xdd273c88cfe22533 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2252c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.070602:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd240030200/0xdd273c88cfe22533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2252c expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.070612:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd240030200/0xdd273c88cfe22533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2252c expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.070619:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240030200, rc 0) 00000100:00100000:0.0:1788796500.070647:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959261824:12345-0@lo:101: Request processed in 79us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.070653:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788796500.070682:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959261824:0@lo:101: 00010000:00010000:0.0:1788796500.070705:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe2252c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22533 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.070714:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe2252c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22533 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796500.070798:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959261952:0@lo:501: 00000100:00100000:0.0:1788796500.070823:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.070843:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796500.070862:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959261952 00000100:00100000:0.0:1788796500.070866:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959261952 00000100:00100000:0.0:1788796500.070883:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788796500.070889:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959261952:12345-0@lo:501: 00000100:00100000:0.0:1788796500.071044:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959261952:12345-0@lo:501: Request processed in 154us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.071051:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788796500.071084:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959261952:0@lo:501: 00000100:00100000:0.0:1788796500.071112:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959262080:0@lo:503: 00000100:00100000:0.0:1788796500.071153:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.071168:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796500.071179:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959262080 00000100:00100000:0.0:1788796500.071182:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959262080 00000100:00100000:0.0:1788796500.071197:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788796500.071203:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959262080:12345-0@lo:503: 00000100:00100000:0.0:1788796500.071350:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959262080:12345-0@lo:503: Request processed in 146us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.071356:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788796500.071393:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959262080:0@lo:503: 00000040:00080000:0.0:1788796500.071706:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788796500.071789:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959262208:0@lo:502: 00000100:00100000:0.0:1788796500.071827:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.071850:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796500.071864:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959262208 00000100:00100000:0.0:1788796500.071868:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959262208 00000100:00100000:0.0:1788796500.071887:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788796500.071893:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959262208:12345-0@lo:502: 00000100:00100000:0.0:1788796500.072030:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959262208:12345-0@lo:502: Request processed in 136us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.072037:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788796500.072074:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959262208:0@lo:502: 00000040:00080000:0.0:1788796500.072326:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788796500.072380:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788796500.072422:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788796500.072478:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788796500.072522:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788796500.072563:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788796500.072588:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959262336:0@lo:502: 00000100:00100000:0.0:1788796500.072626:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.072644:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796500.072658:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959262336 00000100:00100000:0.0:1788796500.072662:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959262336 00000100:00100000:0.0:1788796500.072680:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788796500.072702:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959262336:12345-0@lo:502: 00000100:00100000:0.0:1788796500.072846:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959262336:12345-0@lo:502: Request processed in 146us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.072853:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788796500.072895:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959262336:0@lo:502: 00000040:00080000:0.0:1788796500.072983:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788796500.072993:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:1.0:1788796500.073446:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796500.073456:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2251e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdd273c88cfe22525 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796500.073466:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152fc00 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:1.0:1788796500.073470:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2251e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdd273c88cfe22525 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796500.073481:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2251e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xdd273c88cfe22525 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796500.073489:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2251e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xdd273c88cfe22525 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796500.073495:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788796500.073519:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2251e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd273c88cfe22525 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796500.073540:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796500.073563:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2251e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd273c88cfe22525 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796500.073571:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2251e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdd273c88cfe22525 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796500.073585:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796500.073587:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796500.073589:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788796500.073904:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788796500.073912:0:7640:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788796500.073920:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796500.073922:0:7640:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788796500.073928:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788796500.073944:0:7640:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bd2676919b8) 00000020:00000080:2.0:1788796500.073968:0:7640:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788796500.073976:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788796500.074069:0:7640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd26717e800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788796500.074077:0:7640:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788796500.074084:0:7640:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdd273c88cfe22541 00000100:00100000:0.0:1788796500.077664:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959262464:0@lo:103: 00000100:00100000:0.0:1788796500.077878:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788796500.079767:0:7640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788796500.080164:0:7640:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000100:00100000:1.0:1788796500.080704:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959262464 00000100:00100000:1.0:1788796500.080722:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959262464 00000001:00000004:2.0:1788796500.082482:0:7640:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788796500.083221:0:7640:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00000100:00100000:0.0:1788796500.084266:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796500.084278:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c622680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+13:3304:x1875688959262464:12345-0@lo:103: 00010000:00010000:0.0:1788796500.084307:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796500.084325:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22525 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd273c88cfe2251e expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.084342:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796500.084406:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c622680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+12:3304:x1875688959262464:12345-0@lo:103: Request processed in 131us (6529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.084413:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00080000:10000000:2.0:1788796500.086592:0:7640:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00000100:00100000:1.0:1788796500.087665:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959262464:0@lo:103: 00080000:10000000:2.0:1788796500.087969:0:7640:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788796500.089901:0:7640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788796500.089914:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796500.089920:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796500.089922:0:7640:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788796500.089926:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796500.089929:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796500.089931:0:7640:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788796500.089934:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788796500.089936:0:7640:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788796500.089987:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796500.089996:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796500.089998:0:7640:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788796500.090001:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788796500.090240:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788796500.090265:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788796500.090287:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe2252c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22533 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796500.090300:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe2252c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22533 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796500.090308:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd26717e800 from 1 10000000:01000000:1.0:1788796500.090310:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788796500.090342:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd282052a00/0xdd273c88cfe22548 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796500.090350:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd282052a00/0xdd273c88cfe22548 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796500.090361:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd282052a00/0xdd273c88cfe22548 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796500.090381:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959262592:0@lo:101: 00000100:00100000:1.0:1788796500.090437:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796500.090476:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2467e3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788796500.090533:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959262592 00000100:00100000:0.0:1788796500.090541:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959262592 00000100:00100000:0.0:1788796500.090579:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788796500.090588:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:7632:x1875688959262592:12345-0@lo:101: 00010000:00010000:0.0:1788796500.090600:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796500.090611:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe2254f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe22548 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.090637:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe2254f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe22548 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.090647:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe2254f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22548 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.090656:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240031e00, rc 0) 00000100:00100000:0.0:1788796500.090708:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959262592:12345-0@lo:101: Request processed in 121us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.090715:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788796500.090786:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959262592:0@lo:101: 00010000:00010000:0.0:1788796500.090800:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd282052a00/0xdd273c88cfe22548 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2254f expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.090817:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd282052a00/0xdd273c88cfe22548 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe2254f expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796500.090896:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959262720:0@lo:501: 00000100:00100000:0.0:1788796500.090923:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.090935:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93900 going to sleep for 11 seconds 00000100:00100000:1.0:1788796500.091065:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959262720 00000100:00100000:1.0:1788796500.091070:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959262720 00000100:00100000:1.0:1788796500.091103:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788796500.091110:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959262720:12345-0@lo:501: 00000100:00100000:1.0:1788796500.091325:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959262720:12345-0@lo:501: Request processed in 215us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796500.091337:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788796500.091476:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959262720:0@lo:501: 00000100:00100000:0.0:1788796500.091504:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959262848:0@lo:503: 00000100:00100000:0.0:1788796500.091557:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.091585:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93900 going to sleep for 11 seconds 00000100:00100000:1.0:1788796500.091680:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959262848 00000100:00100000:1.0:1788796500.091695:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959262848 00000100:00100000:1.0:1788796500.091727:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788796500.091735:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959262848:12345-0@lo:503: 00000100:00100000:1.0:1788796500.092034:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959262848:12345-0@lo:503: Request processed in 300us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796500.092111:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788796500.092376:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959262848:0@lo:503: 00000040:00080000:0.0:1788796500.092736:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788796500.092827:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959262976:0@lo:502: 00000100:00100000:0.0:1788796500.092869:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.092899:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93900 going to sleep for 11 seconds 00000100:00100000:1.0:1788796500.092976:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959262976 00000100:00100000:1.0:1788796500.092982:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959262976 00000100:00100000:1.0:1788796500.093010:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788796500.093018:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959262976:12345-0@lo:502: 00000100:00100000:1.0:1788796500.093249:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959262976:12345-0@lo:502: Request processed in 231us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796500.093256:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788796500.093391:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959262976:0@lo:502: 00000040:00080000:0.0:1788796500.093735:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788796500.093900:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788796500.093926:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959263104:0@lo:502: 00000100:00100000:0.0:1788796500.093966:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.093989:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93900 going to sleep for 11 seconds 00000100:00100000:1.0:1788796500.094118:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959263104 00000100:00100000:1.0:1788796500.094124:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959263104 00000100:00100000:1.0:1788796500.094158:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788796500.094166:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959263104:12345-0@lo:502: 00000100:00100000:1.0:1788796500.094375:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959263104:12345-0@lo:502: Request processed in 208us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796500.094382:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788796500.096927:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959263104:0@lo:502: 00000040:00080000:2.0:1788796500.097223:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788796500.097241:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788796500.099901:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796500.099915:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796500.099917:0:7644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788796500.099925:0:7644:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd26717e800 00000020:00000080:2.0:1788796500.099928:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788796500.099949:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796500.099953:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796500.099954:0:7644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788796500.099958:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788796500.103436:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788796500.103484:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788796500.103566:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd282052a00/0xdd273c88cfe22548 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2254f expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796500.103580:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd282052a00/0xdd273c88cfe22548 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2254f expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796500.103647:0:7632:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788796500.103651:0:7632:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd26717e800 10000000:01000000:3.0:1788796500.103654:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd26717e800 10000000:01000000:3.0:1788796500.103658:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788796500.103664:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd26717e800 from 1 10000000:01000000:3.0:1788796500.103667:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788796500.103717:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5000/0xdd273c88cfe22556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796500.103726:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5000/0xdd273c88cfe22556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796500.103737:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5000/0xdd273c88cfe22556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796500.103782:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959263232:0@lo:101: 00000100:00100000:3.0:1788796500.103845:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796500.103884:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df36240 going to sleep for 11 seconds 00000100:00100000:2.0:1788796500.105212:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959263232 00000100:00100000:2.0:1788796500.105221:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959263232 00000100:00100000:2.0:1788796500.105309:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788796500.105322:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959263232:12345-0@lo:101: 00010000:00010000:2.0:1788796500.105338:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796500.105355:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe2255d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe22556 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.105383:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe2255d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe22556 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.105396:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe2255d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22556 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.105405:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd24152e400, rc 0) 00000100:00100000:2.0:1788796500.105478:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+14:7632:x1875688959263232:12345-0@lo:101: Request processed in 159us (1631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796500.105498:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788796500.105728:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959263232:0@lo:101: 00010000:00010000:3.0:1788796500.105786:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5000/0xdd273c88cfe22556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2255d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796500.105796:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5000/0xdd273c88cfe22556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe2255d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796500.105912:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959263360:0@lo:501: 00000100:00100000:3.0:1788796500.105944:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796500.106078:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df36240 going to sleep for 11 seconds 00000100:00100000:0.0:1788796500.106222:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959263360 00000100:00100000:0.0:1788796500.106228:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959263360 00000100:00100000:0.0:1788796500.106254:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788796500.106261:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:7632:x1875688959263360:12345-0@lo:501: 00000100:00100000:0.0:1788796500.106502:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:7632:x1875688959263360:12345-0@lo:501: Request processed in 240us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796500.106508:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788796500.106651:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959263360:0@lo:501: 00000100:00100000:3.0:1788796500.106681:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959263488:0@lo:503: 00000100:00100000:3.0:1788796500.106733:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796500.106777:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df36240 going to sleep for 11 seconds 00000100:00100000:2.0:1788796500.106845:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959263488 00000100:00100000:2.0:1788796500.106850:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959263488 00000100:00100000:2.0:1788796500.106872:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788796500.106878:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+14:7632:x1875688959263488:12345-0@lo:503: 00000100:00100000:2.0:1788796500.107023:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+14:7632:x1875688959263488:12345-0@lo:503: Request processed in 144us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796500.107029:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788796500.107186:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959263488:0@lo:503: 00000040:00080000:3.0:1788796500.107442:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788796500.107515:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959263616:0@lo:502: 00000100:00100000:3.0:1788796500.107730:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796500.107784:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df36240 going to sleep for 11 seconds 00000100:00100000:2.0:1788796500.107887:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959263616 00000100:00100000:2.0:1788796500.107892:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959263616 00000100:00100000:2.0:1788796500.107921:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788796500.107927:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+14:7632:x1875688959263616:12345-0@lo:502: 00000100:00100000:2.0:1788796500.108280:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+14:7632:x1875688959263616:12345-0@lo:502: Request processed in 351us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796500.108287:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788796500.108365:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959263616:0@lo:502: 00000040:00080000:3.0:1788796500.108712:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788796500.109146:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788796500.109191:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788796500.109243:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788796500.109284:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788796500.109337:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788796500.109379:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788796500.109415:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788796500.109467:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788796500.109506:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788796500.109723:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788796500.109854:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788796500.109893:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788796500.109943:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788796500.109994:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788796500.110033:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788796500.110186:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788796500.110238:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788796500.110278:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788796500.110314:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788796500.110371:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788796500.110428:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788796500.110467:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788796500.110520:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788796500.110638:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788796500.110674:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788796500.110739:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788796500.110902:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788796500.110937:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788796500.111010:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788796500.111130:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788796500.111168:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788796500.111204:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788796500.111255:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788796500.111292:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788796500.111357:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788796500.111398:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788796500.111446:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959263744:0@lo:502: 00000100:00100000:3.0:1788796500.111523:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796500.111706:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df36240 going to sleep for 11 seconds 00000100:00100000:1.0:1788796500.112625:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959263744 00000100:00100000:1.0:1788796500.112635:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959263744 00000100:00100000:1.0:1788796500.112704:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788796500.112716:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+14:7632:x1875688959263744:12345-0@lo:502: 00000100:00100000:1.0:1788796500.113199:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+14:7632:x1875688959263744:12345-0@lo:502: Request processed in 484us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796500.113208:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788796500.113348:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959263744:0@lo:502: 00000040:00080000:3.0:1788796500.113465:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788796500.113480:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788796500.114436:0:7645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788796500.114451:0:7645:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bd2673e3370) 00000020:00000080:0.0:1788796500.114472:0:7645:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788796500.114622:0:7645:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd26717e800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788796500.114626:0:7645:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd26717e800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788796500.114629:0:7645:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd26717e800 3 00010000:00080000:0.0:1788796500.114658:0:7645:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd267179000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.125@tcp at head 00010000:00010000:0.0:1788796500.116892:0:7645:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788796500.117160:0:7645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788796500.117198:0:7645:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788796500.117227:0:7645:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdd273c88cfe2256b 00000100:00080000:0.0:1788796500.117239:0:7645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788796500.117250:0:7645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd267179000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1788796500.117289:0:7645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd26c621880 x1875688959263872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788796500.117315:0:7645:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788796500.117563:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875688959263872:0@lo:38: 00000100:00100000:1.0:1788796500.117627:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796500.117852:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959264128:0@lo:400: 00000100:00100000:3.0:1788796500.117886:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796500.117909:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796500.117915:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959264256:0@lo:400: 00000100:00100000:3.0:1788796500.117938:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796500.117970:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959263872 00000100:00100000:3.0:1788796500.117977:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959263872 00000100:00100000:3.0:1788796500.118003:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959264128 00000100:00100000:3.0:1788796500.118006:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959264128 00000100:00100000:3.0:1788796500.118048:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788796500.118057:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959264128:12345-0@lo:400: 00000100:00100000:3.0:1788796500.118101:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959264128:12345-0@lo:400: Request processed in 45us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796500.118107:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788796500.118122:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788796500.118125:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875688959263872:12345-0@lo:38: 00010000:00080000:3.0:1788796500.118142:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1788796500.118169:0:5846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdd273c88cfe22572 00000004:00100000:3.0:1788796500.118184:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788796500.118213:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9bd27d145000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788796500.118249:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875688959263872:12345-0@lo:38: Request processed in 122us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796500.118256:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788796500.118275:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959264256 00000100:00100000:3.0:1788796500.118278:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959264256 00000100:00100000:3.0:1788796500.118306:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788796500.118312:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959264256:12345-0@lo:400: 00000100:00100000:3.0:1788796500.118339:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959264256:12345-0@lo:400: Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796500.118350:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788796500.118368:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788796500.118371:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788796500.118399:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27ecb9f80 x1875688959264256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796500.118413:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959264256:0@lo:400: 00010000:00080000:3.0:1788796500.118421:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27ecb8a80 x1875688959264128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796500.118429:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959264128:0@lo:400: 00010000:00080000:3.0:1788796500.118454:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd26c621880 x1875688959263872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788796510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796500.118462:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788796500.118467:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788796500.118473:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788796500.118476:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788796500.118479:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd267179000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788796500.118484:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875688959263872:0@lo:38: 00000100:00100000:3.0:1788796500.118496:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788796500.118503:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959264000:0@lo:400: 00000100:00100000:3.0:1788796500.118643:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796500.118672:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959264000 00000100:00100000:3.0:1788796500.118676:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959264000 00000100:00100000:3.0:1788796500.118707:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788796500.118712:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959264000:12345-0@lo:400: 00000100:00100000:3.0:1788796500.118743:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959264000:12345-0@lo:400: Request processed in 30us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796500.118784:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788796500.118809:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27ecb8380 x1875688959264000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796500.118818:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959264000:0@lo:400: 00000040:00080000:0.0:1788796500.119025:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788796500.119242:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788796500.119266:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788796500.119287:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5000/0xdd273c88cfe22556 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2255d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796500.119299:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5000/0xdd273c88cfe22556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2255d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788796500.119343:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788796500.119346:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788796500.119347:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788796500.119348:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788796500.119349:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788796500.119351:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788796500.119352:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788796500.119354:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788796500.119355:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788796500.119356:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788796500.119358:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788796500.119361:0:7632:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788796500.119364:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788796500.119365:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788796500.119366:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788796500.119367:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788796500.119368:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788796500.119369:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788796500.119370:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788796500.119371:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788796500.119372:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788796500.119378:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788796500.119378:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788796500.119394:0:7632:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788796500.119405:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959264384:0@lo:253: 00000100:00100000:3.0:1788796500.119437:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796500.119469:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df36600 going to sleep for 11 seconds 00000100:00100000:3.0:1788796500.119510:0:7646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ecb9f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7646:1875688959264512:0@lo:901: 00000100:00100000:3.0:1788796500.119657:0:7646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796500.119693:0:7646:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df36840 going to sleep for 11 seconds 00000100:00100000:1.0:1788796500.119780:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959264512 00000100:00100000:1.0:1788796500.119786:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959264512 00000100:00100000:1.0:1788796500.119821:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788796500.119828:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7646:x1875688959264512:12345-0@lo:901: 00000100:00100000:1.0:1788796500.120161:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7646:x1875688959264512:12345-0@lo:901: Request processed in 332us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796500.120169:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788796500.120305:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959264384 00000100:00100000:0.0:1788796500.120311:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959264384 00000100:00100000:0.0:1788796500.120349:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788796500.120356:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+14:7632:x1875688959264384:12345-0@lo:253: 20000000:01000000:0.0:1788796500.120375:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788796500.120389:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1788796500.121246:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788796500.123261:0:7646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27ecb9f80 x1875688959264512/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788796516 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796500.123281:0:7646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb9f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7646:1875688959264512:0@lo:901: 20000000:01000000:2.0:1788796500.158371:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788796500.158389:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788796500.158439:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788796500.158445:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788796500.158479:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22579 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.158497:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd24152f800/0xdd273c88cfe224ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe224c3 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.158505:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22579 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.158559:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd24152f800/0xdd273c88cfe224ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe224c3 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796500.158573:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd24152f800/0xdd273c88cfe224ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe224c3 expref: 14 pid: 5837 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796500.158587:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c620000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875688959264640:0@lo:104: 00000100:00100000:0.0:1788796500.158647:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796500.158709:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24d980c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796500.159208:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959264640 00000100:00100000:2.0:1788796500.159217:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959264640 00000100:00100000:2.0:1788796500.159266:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788796500.159276:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f7145a2-0840-45a5-acde-da959fc7802f+3:5860:x1875688959264640:12345-0@lo:104: 00010000:00010000:2.0:1788796500.159289:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd282052e00/0xdd273c88cfe224c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe224ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159347:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788796500.159353:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f7145a2-0840-45a5-acde-da959fc7802f+3:5860:x1875688959264640:12345-0@lo:104: Request processed in 79us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796500.159373:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788796500.159396:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796500.159401:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd282052e00/0xdd273c88cfe224c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe224ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159409:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd282052e00 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:2.0:1788796500.159414:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd282052e00/0xdd273c88cfe224c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe224ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159422:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd282052e00/0xdd273c88cfe224c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe224ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796500.159430:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd282052e00/0xdd273c88cfe224c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe224ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796500.159436:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788796500.159465:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd282052e00/0xdd273c88cfe224c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe224ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159471:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796500.159488:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd282052e00/0xdd273c88cfe224c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe224ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159495:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd282052e00/0xdd273c88cfe224c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe224ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159510:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796500.159512:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796500.159513:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796500.159520:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788796500.159548:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959264768:0@lo:103: 00000100:00100000:2.0:1788796500.159580:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796500.159610:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959264768 00000100:00100000:2.0:1788796500.159614:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959264768 00010000:00010000:2.0:1788796500.159630:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd24152f800/0xdd273c88cfe224ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe224c3 expref: 15 pid: 5837 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796500.159651:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788796500.159658:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd245990850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+15:3305:x1875688959264768:12345-0@lo:103: 00010000:00010000:2.0:1788796500.159668:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796500.159673:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd24152f800/0xdd273c88cfe224ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe224c3 expref: 15 pid: 5837 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159695:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd24152f800/0xdd273c88cfe224ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe224c3 expref: 15 pid: 5837 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159711:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22579 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159720:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22579 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788796500.159733:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005362517s 00010000:00010000:2.0:1788796500.159738:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22579 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159769:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22579 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159777:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22579 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159793:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22579 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159800:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240030e00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796500.159804:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22579 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159812:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22579 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159821:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22579 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159831:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796500.159862:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd245990850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+15:3305:x1875688959264768:12345-0@lo:103: Request processed in 204us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796500.159868:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788796500.159937:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959264768:0@lo:103: 00010000:00010000:2.0:1788796500.159961:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd24152f800/0xdd273c88cfe224ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe224c3 expref: 14 pid: 5837 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796500.159972:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c620000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875688959264640:0@lo:104: 00010000:00010000:2.0:1788796500.159983:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22579 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159990:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22579 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.159996:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22579 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796500.160009:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe22579 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796500.169928:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+13:7632:x1875688959264384:12345-0@lo:253: Request processed in 49564us (50481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796500.169943:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788796500.170032:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ecb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7f7145a2-0840-45a5-acde-da959fc7802f:7632:1875688959264384:0@lo:253: 10000000:01000000:3.0:1788796500.170117:0:7632:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788796500.170120:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788796500.170122:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788796500.170124:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788796500.170125:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788796500.170126:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788796500.170127:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788796500.170129:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788796500.170131:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788796500.170132:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788796500.170133:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788796500.170134:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788796500.170149:0:7632:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788796500.174974:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788796500.175284:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788796500.175514:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788796500.176280:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788796500.176514:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788796500.177343:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788796500.180424:0:7632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788796500.317626:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788796500.427689:0:7632:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788796500.427697:0:7632:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788796500.427734:0:7632:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788796500.427830:0:7632:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788796500.427845:0:7632:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788796500.427874:0:7632:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788796501.338486:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796502.367540:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796502.874089:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959264896:0@lo:13: 00000100:00100000:3.0:1788796502.874179:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796502.874296:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959264896 00000100:00100000:1.0:1788796502.874305:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959264896 00000100:00100000:1.0:1788796502.874367:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788796502.874377:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959264896:12345-0@lo:13: 00002000:00000024:1.0:1788796502.874411:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796502.874457:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959264896:12345-0@lo:13: Request processed in 82us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796502.874464:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788796502.874620:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788796502.874660:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd25030d180 x1875688959264896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796502.874678:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959264896:0@lo:13: 00010000:00010000:3.0:1788796503.389960:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796504.410661:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796505.434036:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796505.439403:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959265280:0@lo:400: 00000100:00100000:3.0:1788796505.439497:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959265024:0@lo:400: 00000100:00100000:2.0:1788796505.450639:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c620a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959265152:0@lo:400: 00000100:00100000:3.0:1788796505.451527:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796505.451609:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959265536:0@lo:400: 00000100:00100000:3.0:1788796505.451649:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796505.451694:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959265408:0@lo:400: 00000100:00100000:3.0:1788796505.451724:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796505.451772:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959265536 00000100:00100000:3.0:1788796505.451781:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959265536 00000100:00100000:3.0:1788796505.451850:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788796505.451858:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959265536:12345-0@lo:400: 00000100:00100000:3.0:1788796505.451916:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959265536:12345-0@lo:400: Request processed in 57us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796505.451922:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788796505.451948:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959265408 00000100:00100000:3.0:1788796505.451952:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959265408 00000100:00100000:3.0:1788796505.451979:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788796505.451985:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959265408:12345-0@lo:400: 00000100:00100000:3.0:1788796505.452021:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959265408:12345-0@lo:400: Request processed in 35us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796505.452026:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788796505.452066:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788796505.452072:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788796505.452395:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd26c620380 x1875688959265408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796505.452412:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959265408:0@lo:400: 00010000:00080000:3.0:1788796505.452447:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd26c620000 x1875688959265536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796505.452457:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959265536:0@lo:400: 00000100:00100000:0.0:1788796505.456349:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796505.456457:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959265024 00000100:00100000:0.0:1788796505.456468:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959265024 00000100:00100000:0.0:1788796505.456527:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788796505.456538:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+13:3306:x1875688959265024:12345-0@lo:400: 00000100:00100000:0.0:1788796505.456633:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+13:3306:x1875688959265024:12345-0@lo:400: Request processed in 96us (5109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796505.456640:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788796505.456709:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959265024:0@lo:400: 00000100:00100000:3.0:1788796505.462265:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959265280 00000100:00100000:3.0:1788796505.462282:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959265280 00000100:00100000:3.0:1788796505.462364:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788796505.462374:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959265280:12345-0@lo:400: 00000100:00100000:3.0:1788796505.462490:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959265280:12345-0@lo:400: Request processed in 117us (6148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796505.462498:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788796505.462521:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788796505.462817:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd26c623100 x1875688959265280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796505.462834:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959265280:0@lo:400: 00000100:00100000:2.0:1788796505.463836:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796505.463979:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959265152 00000100:00100000:3.0:1788796505.463987:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959265152 00000100:00100000:3.0:1788796505.464128:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788796505.464138:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959265152:12345-0@lo:400: 00000100:00100000:3.0:1788796505.464197:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959265152:12345-0@lo:400: Request processed in 62us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796505.464204:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788796505.464318:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd26c620a80 x1875688959265152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796505.464331:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c620a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959265152:0@lo:400: 10000000:01000000:3.0:1788796505.958723:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788796505.958730:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd2467d7000 from 30 10000000:01000000:3.0:1788796505.958736:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788796505.958795:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4600/0xdd273c88cfe22580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796505.958818:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4600/0xdd273c88cfe22580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796505.958829:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4600/0xdd273c88cfe22580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796505.958852:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959265664:0@lo:101: 00000100:00100000:3.0:1788796505.958940:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796505.958992:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250283300 going to sleep for 11 seconds 00000100:00100000:3.0:1788796505.962920:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959265664 00000100:00100000:3.0:1788796505.962936:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959265664 00000100:00100000:3.0:1788796505.963010:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788796505.963022:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+13:5841:x1875688959265664:12345-0@lo:101: 00010000:00010000:3.0:1788796505.963041:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796505.963063:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe22587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe22580 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796505.963094:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe22587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe22580 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796505.963104:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe22587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22580 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796505.963112:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d4000, rc 0) 00000100:00100000:3.0:1788796505.963204:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959265664:12345-0@lo:101: Request processed in 184us (4263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796505.963210:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788796505.963267:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959265664:0@lo:101: 00010000:00010000:3.0:1788796505.963300:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4600/0xdd273c88cfe22580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22587 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796505.963309:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4600/0xdd273c88cfe22580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22587 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796505.963375:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959265792:0@lo:501: 00000100:00100000:3.0:1788796505.963410:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796505.963433:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250283300 going to sleep for 11 seconds 00000100:00100000:3.0:1788796505.963447:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959265792 00000100:00100000:3.0:1788796505.963451:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959265792 00000100:00100000:3.0:1788796505.963474:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788796505.963481:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959265792:12345-0@lo:501: 00000100:00100000:3.0:1788796505.963875:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959265792:12345-0@lo:501: Request processed in 393us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796505.963883:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788796505.963918:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959265792:0@lo:501: 00000100:00100000:3.0:1788796505.963951:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959265920:0@lo:503: 00000100:00100000:3.0:1788796505.963991:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796505.964005:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250283300 going to sleep for 11 seconds 00000100:00100000:3.0:1788796505.964016:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959265920 00000100:00100000:3.0:1788796505.964020:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959265920 00000100:00100000:3.0:1788796505.964042:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788796505.964049:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959265920:12345-0@lo:503: 00000100:00100000:3.0:1788796505.964316:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959265920:12345-0@lo:503: Request processed in 266us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796505.964322:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788796505.964369:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959265920:0@lo:503: 00000100:00100000:3.0:1788796505.964556:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7923:1875688959266048:0@lo:502: 00000100:00100000:3.0:1788796505.964605:0:7923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796505.964624:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959266048 00000100:00100000:3.0:1788796505.964628:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959266048 00000100:00100000:3.0:1788796505.964651:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788796505.964657:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:7923:x1875688959266048:12345-0@lo:502: 00000100:00100000:3.0:1788796505.964886:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:7923:x1875688959266048:12345-0@lo:502: Request processed in 228us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796505.964892:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788796505.964923:0:7923:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250283cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796505.964936:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7923:1875688959266048:0@lo:502: 00000100:00100000:3.0:1788796505.964978:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7923:1875688959266176:0@lo:502: 00000100:00100000:3.0:1788796505.965010:0:7923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796505.965029:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959266176 00000100:00100000:3.0:1788796505.965033:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959266176 00000100:00100000:3.0:1788796505.965054:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788796505.965059:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:7923:x1875688959266176:12345-0@lo:502: 00000100:00100000:3.0:1788796505.965177:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:7923:x1875688959266176:12345-0@lo:502: Request processed in 117us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796505.965183:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788796505.965208:0:7923:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250283cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796505.965219:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7923:1875688959266176:0@lo:502: 00000040:00080000:3.0:1788796505.965236:0:7923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788796505.965287:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788796505.965306:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788796505.965321:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4600/0xdd273c88cfe22580 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22587 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796505.965331:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4600/0xdd273c88cfe22580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22587 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796505.965340:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788796505.965342:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788796505.965345:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788796505.965368:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2258e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796505.965377:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2258e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796505.965387:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2258e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796505.965398:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959266304:0@lo:101: 00000100:00100000:3.0:1788796505.965423:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796505.965436:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250283cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796505.965448:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959266304 00000100:00100000:3.0:1788796505.965452:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959266304 00000100:00100000:3.0:1788796505.965472:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788796505.965479:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959266304:12345-0@lo:101: 00010000:00010000:3.0:1788796505.965487:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796505.965498:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2258e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796505.965517:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2258e expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796505.965534:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2258e expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796505.965543:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5200, rc 0) 00000100:00100000:3.0:1788796505.965572:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959266304:12345-0@lo:101: Request processed in 93us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796505.965577:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788796505.965625:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959266304:0@lo:101: 00010000:00010000:3.0:1788796505.965636:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2258e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22595 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796505.965643:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2258e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22595 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796505.965678:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959266432:0@lo:501: 00000100:00100000:3.0:1788796505.965700:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796505.965712:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250283cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796505.965723:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959266432 00000100:00100000:3.0:1788796505.965726:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959266432 00000100:00100000:3.0:1788796505.965765:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788796505.965772:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959266432:12345-0@lo:501: 00000100:00100000:3.0:1788796505.965964:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959266432:12345-0@lo:501: Request processed in 192us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796505.965970:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788796505.965999:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959266432:0@lo:501: 00000100:00100000:3.0:1788796505.966022:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959266560:0@lo:503: 00000100:00100000:3.0:1788796505.966059:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796505.966072:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250283cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796505.966082:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959266560 00000100:00100000:3.0:1788796505.966085:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959266560 00000100:00100000:3.0:1788796505.966106:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788796505.966112:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959266560:12345-0@lo:503: 00000100:00100000:3.0:1788796505.966368:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959266560:12345-0@lo:503: Request processed in 255us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796505.966374:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788796505.966413:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959266560:0@lo:503: 00000100:00100000:2.0:1788796505.970709:0:7924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7924:1875688959266688:0@lo:502: 00000100:00100000:2.0:1788796505.970807:0:7924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796505.970847:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959266688 00000100:00100000:2.0:1788796505.970853:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959266688 00000100:00100000:2.0:1788796505.970897:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788796505.970906:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+15:7924:x1875688959266688:12345-0@lo:502: 00000100:00100000:3.0:1788796505.973487:0:7924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df36780 going to sleep for 11 seconds 00000100:00100000:2.0:1788796505.973734:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+15:7924:x1875688959266688:12345-0@lo:502: Request processed in 2826us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796505.973762:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788796505.984982:0:7924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7924:1875688959266688:0@lo:502: 00000020:01000000:2.0:1788796506.002110:0:7924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796506.002149:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796506.002153:0:7924:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788796506.002160:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788796506.002177:0:7924:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788796506.002227:0:7924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7924:1875688959266816:0@lo:502: 00000100:00100000:2.0:1788796506.002314:0:7924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796506.002371:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959266816 00000100:00100000:2.0:1788796506.002379:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959266816 00000100:00100000:2.0:1788796506.002447:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788796506.002457:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+15:7924:x1875688959266816:12345-0@lo:502: 00000100:00100000:2.0:1788796506.002689:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+15:7924:x1875688959266816:12345-0@lo:502: Request processed in 232us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796506.002696:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788796506.002777:0:7924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df36cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796506.002801:0:7924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7924:1875688959266816:0@lo:502: 00000020:01000000:2.0:1788796506.002827:0:7924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796506.002831:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796506.002833:0:7924:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788796506.002836:0:7924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788796506.002895:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788796506.002915:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788796506.002925:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2258e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22595 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796506.002937:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2258e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22595 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796506.002947:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788796506.002949:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd250afa000 from 30 10000000:01000000:2.0:1788796506.002952:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788796506.002977:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2259c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796506.002997:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2259c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796506.003006:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2259c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796506.003019:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959266944:0@lo:101: 00000100:00100000:2.0:1788796506.003048:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796506.003063:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df36cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796506.003078:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959266944 00000100:00100000:2.0:1788796506.003082:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959266944 00000100:00100000:2.0:1788796506.003104:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788796506.003111:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959266944:12345-0@lo:101: 00010000:00010000:2.0:1788796506.003119:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796506.003132:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe225a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2259c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796506.003152:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe225a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2259c expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796506.003162:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe225a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2259c expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796506.003171:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd24152fc00, rc 0) 00000100:00100000:2.0:1788796506.003200:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959266944:12345-0@lo:101: Request processed in 89us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796506.003205:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788796506.003234:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959266944:0@lo:101: 00010000:00010000:2.0:1788796506.003253:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2259c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe225a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796506.003260:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2259c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe225a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796506.003298:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959267072:0@lo:501: 00000100:00100000:2.0:1788796506.003322:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796506.003334:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df36cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796506.003345:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959267072 00000100:00100000:2.0:1788796506.003349:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959267072 00000100:00100000:2.0:1788796506.003368:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788796506.003374:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959267072:12345-0@lo:501: 00000100:00100000:2.0:1788796506.003602:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959267072:12345-0@lo:501: Request processed in 226us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796506.003609:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788796506.003636:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959267072:0@lo:501: 00000100:00100000:2.0:1788796506.003661:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959267200:0@lo:503: 00000100:00100000:2.0:1788796506.003693:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796506.003708:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df36cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796506.003719:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959267200 00000100:00100000:2.0:1788796506.003722:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959267200 00000100:00100000:2.0:1788796506.003742:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788796506.003769:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959267200:12345-0@lo:503: 00000100:00100000:2.0:1788796506.003896:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959267200:12345-0@lo:503: Request processed in 128us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796506.003902:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788796506.003944:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959267200:0@lo:503: 00000100:00100000:2.0:1788796506.017529:0:7925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7925:1875688959267328:0@lo:502: 00000100:00100000:2.0:1788796506.017620:0:7925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796506.017668:0:7925:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796506.017717:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959267328 00000100:00100000:3.0:1788796506.017724:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959267328 00000100:00100000:3.0:1788796506.017799:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788796506.017809:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:7925:x1875688959267328:12345-0@lo:502: 00000100:00100000:3.0:1788796506.018058:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:7925:x1875688959267328:12345-0@lo:502: Request processed in 250us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796506.018066:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788796506.018195:0:7925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7925:1875688959267328:0@lo:502: 00000100:00100000:0.0:1788796506.018244:0:7925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7925:1875688959267456:0@lo:502: 00000100:00100000:0.0:1788796506.018278:0:7925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796506.018305:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959267456 00000100:00100000:0.0:1788796506.018309:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959267456 00000100:00100000:0.0:1788796506.018331:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788796506.018338:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+16:7925:x1875688959267456:12345-0@lo:502: 00000100:00100000:0.0:1788796506.018463:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+16:7925:x1875688959267456:12345-0@lo:502: Request processed in 125us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796506.018471:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788796506.018506:0:7925:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26737e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788796506.018518:0:7925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7925:1875688959267456:0@lo:502: 00000040:00080000:0.0:1788796506.018536:0:7925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788796506.018840:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788796506.018858:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788796506.018868:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2259c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe225a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.018879:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2259c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe225a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796506.018900:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788796506.018903:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd250afa000 from 5 10000000:01000000:3.0:1788796506.018905:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788796506.018930:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.018938:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.018946:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796506.018959:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959267584:0@lo:101: 00000100:00100000:3.0:1788796506.018989:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796506.019007:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250283cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796506.019071:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959267584 00000100:00100000:0.0:1788796506.019075:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959267584 00000100:00100000:0.0:1788796506.019109:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788796506.019115:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959267584:12345-0@lo:101: 00010000:00010000:0.0:1788796506.019206:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796506.019220:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd240031a00/0xdd273c88cfe225b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe225aa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796506.019241:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd240031a00/0xdd273c88cfe225b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe225aa expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796506.019250:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd240031a00/0xdd273c88cfe225b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe225aa expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796506.019258:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240031a00, rc 0) 00000100:00100000:0.0:1788796506.019295:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959267584:12345-0@lo:101: Request processed in 179us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796506.019301:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788796506.019366:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959267584:0@lo:101: 00010000:00010000:3.0:1788796506.019380:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe225b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.019388:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe225b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796506.019428:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959267712:0@lo:256: 00000100:00100000:3.0:1788796506.019456:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796506.019485:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250283cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796506.019525:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959267712 00000100:00100000:0.0:1788796506.019530:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959267712 00000100:00100000:0.0:1788796506.019595:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788796506.019602:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959267712:12345-0@lo:256: 20000000:01000000:0.0:1788796506.019615:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788796506.019633:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788796506.019636:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788796506.019711:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959267712:12345-0@lo:256: Request processed in 109us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796506.019716:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788796506.024343:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959267712:0@lo:256: 10000000:01000000:3.0:1788796506.024425:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788796506.024443:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe225b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.024454:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe225b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796506.024463:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788796506.024465:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788796506.024468:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788796506.024502:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5e00/0xdd273c88cfe225b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.024512:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5e00/0xdd273c88cfe225b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.024521:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5e00/0xdd273c88cfe225b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796506.024539:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959267840:0@lo:101: 00000100:00100000:3.0:1788796506.024608:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796506.024639:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250283cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796506.024659:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959267840 00000100:00100000:3.0:1788796506.024665:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959267840 00000100:00100000:3.0:1788796506.024701:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788796506.024709:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959267840:12345-0@lo:101: 00010000:00010000:3.0:1788796506.024721:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796506.024741:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2821d5600/0xdd273c88cfe225bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe225b8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.024782:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2821d5600/0xdd273c88cfe225bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe225b8 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.024800:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2821d5600/0xdd273c88cfe225bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe225b8 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.024809:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5600, rc 0) 00000100:00100000:3.0:1788796506.024847:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959267840:12345-0@lo:101: Request processed in 138us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796506.024854:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788796506.024892:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959267840:0@lo:101: 00010000:00010000:3.0:1788796506.024904:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5e00/0xdd273c88cfe225b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe225bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.024913:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5e00/0xdd273c88cfe225b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe225bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796506.024959:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959267968:0@lo:501: 00000100:00100000:3.0:1788796506.024984:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796506.025000:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250283cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796506.025011:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959267968 00000100:00100000:3.0:1788796506.025016:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959267968 00000100:00100000:3.0:1788796506.025032:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788796506.025038:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959267968:12345-0@lo:501: 00000100:00100000:3.0:1788796506.031940:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959267968:12345-0@lo:501: Request processed in 6893us (6946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796506.031954:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788796506.032089:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959267968:0@lo:501: 00000100:00100000:2.0:1788796506.032145:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959268096:0@lo:503: 00000100:00100000:2.0:1788796506.032195:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796506.032235:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796506.032284:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959268096 00000100:00100000:3.0:1788796506.032291:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959268096 00000100:00100000:3.0:1788796506.032342:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788796506.032351:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959268096:12345-0@lo:503: 00000100:00100000:3.0:1788796506.032654:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959268096:12345-0@lo:503: Request processed in 303us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796506.032660:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788796506.032699:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959268096:0@lo:503: 00000100:00100000:3.0:1788796506.032920:0:7926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7926:1875688959268224:0@lo:502: 00000100:00100000:3.0:1788796506.032957:0:7926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796506.032979:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959268224 00000100:00100000:3.0:1788796506.032983:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959268224 00000100:00100000:3.0:1788796506.033005:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788796506.033011:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+18:7926:x1875688959268224:12345-0@lo:502: 00000100:00100000:3.0:1788796506.033209:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+18:7926:x1875688959268224:12345-0@lo:502: Request processed in 196us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796506.033216:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788796506.033245:0:7926:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd251ba5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796506.033259:0:7926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7926:1875688959268224:0@lo:502: 00000020:01000000:3.0:1788796506.033282:0:7926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788796506.033289:0:7926:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788796506.033296:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796506.033298:0:7926:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788796506.033302:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788796506.033305:0:7926:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.125@tcp to nid 0x20000c0a8c97d (192.168.201.125@tcp) 00000020:01000000:3.0:1788796506.033325:0:7926:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788796506.033327:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788796506.033341:0:7926:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bd27cfbb370) 00000020:00000080:3.0:1788796506.033360:0:7926:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788796506.033373:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788796506.033434:0:7926:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788796506.033439:0:7926:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788796506.033445:0:7926:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd273c88cfe225cd 00010000:00080000:3.0:1788796506.033471:0:7926:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd26717a000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:3.0:1788796506.033698:0:7926:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788796506.034013:0:7926:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788796506.034026:0:7926:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788796506.034540:0:7926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788796506.047470:0:7926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788796506.047528:0:7926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788796506.047608:0:7926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788796506.049068:0:7927:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788796506.049075:0:7927:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788796506.049821:0:7926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788796506.049835:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788796506.049867:0:7926:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788796506.049890:0:7926:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd273c88cfe225d4 00000100:00080000:3.0:1788796506.049901:0:7926:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788796506.049913:0:7926:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd26717a000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:3.0:1788796506.049953:0:7926:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27ead9180 x1875688959268352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788796506.049982:0:7926:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788796506.050035:0:7926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796506.050039:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796506.050041:0:7926:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788796506.050044:0:7926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796506.050048:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796506.050050:0:7926:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788796506.050053:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788796506.050054:0:7926:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788796506.050081:0:7926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7926:1875688959268480:0@lo:502: 00000100:00100000:3.0:1788796506.050226:0:7926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796506.050264:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959268480 00000100:00100000:3.0:1788796506.050271:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959268480 00000100:00100000:3.0:1788796506.050314:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788796506.050322:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+18:7926:x1875688959268480:12345-0@lo:502: 00000100:00100000:3.0:1788796506.050546:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+18:7926:x1875688959268480:12345-0@lo:502: Request processed in 224us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796506.050554:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788796506.050617:0:7926:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24667c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788796506.050640:0:7926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:7926:1875688959268480:0@lo:502: 00000020:01000000:3.0:1788796506.050668:0:7926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796506.050672:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796506.050674:0:7926:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788796506.050677:0:7926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788796506.050727:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788796506.050769:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788796506.050779:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5e00/0xdd273c88cfe225b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe225bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.050789:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5e00/0xdd273c88cfe225b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe225bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796506.050798:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788796506.050801:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd26caa3370 from 1 10000000:01000000:3.0:1788796506.050804:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788796506.050840:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20200/0xdd273c88cfe225db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.050848:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd247d20200/0xdd273c88cfe225db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.050858:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd247d20200/0xdd273c88cfe225db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796506.050881:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959268608:0@lo:101: 00000100:00100000:3.0:1788796506.050914:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796506.050930:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24667c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788796506.050944:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959268608 00000100:00100000:3.0:1788796506.050948:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959268608 00000100:00100000:3.0:1788796506.050971:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788796506.050978:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959268608:12345-0@lo:101: 00010000:00010000:3.0:1788796506.050987:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796506.050999:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d21400/0xdd273c88cfe225e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe225db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.051021:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d21400/0xdd273c88cfe225e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe225db expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.051030:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d21400/0xdd273c88cfe225e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe225db expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.051038:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21400, rc 0) 00000100:00100000:3.0:1788796506.051067:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959268608:12345-0@lo:101: Request processed in 90us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796506.051073:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788796506.051104:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959268608:0@lo:101: 00010000:00010000:3.0:1788796506.051117:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd247d20200/0xdd273c88cfe225db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe225e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796506.051305:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959268736:0@lo:400: 00000100:00100000:2.0:1788796506.051338:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796506.051361:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788796506.051367:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959269120:0@lo:400: 00000100:00100000:2.0:1788796506.051393:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796506.051422:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959268864:0@lo:400: 00000100:00100000:2.0:1788796506.051448:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796506.051465:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796506.051470:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959268992:0@lo:400: 00000100:00100000:2.0:1788796506.051492:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796506.051597:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959268352:0@lo:8: 00000100:00100000:1.0:1788796506.051630:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796506.051717:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959268992 00000100:00100000:2.0:1788796506.051722:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959268992 00000100:00100000:2.0:1788796506.051785:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959268352 00000100:00100000:2.0:1788796506.051789:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959268352 00000100:00100000:2.0:1788796506.051801:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788796506.051807:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959268992:12345-0@lo:400: 00000100:00100000:2.0:1788796506.051858:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959268992:12345-0@lo:400: Request processed in 52us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796506.051865:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788796506.051878:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788796506.051883:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3303:x1875688959268352:12345-0@lo:8: 00010000:00080000:2.0:1788796506.051904:0:6694:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:2.0:1788796506.051933:0:6694:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd273c88cfe225e9 00002000:00100000:2.0:1788796506.051947:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bd2503ad000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788796506.051951:0:6694:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788796506.051954:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788796506.052086:0:6694:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788796506.052256:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788796506.052283:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9bd2503a9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788796506.052327:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1875688959268352:12345-0@lo:8: Request processed in 441us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796506.052333:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788796506.052384:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27ead9180 x1875688959268352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788796516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796506.052395:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788796506.052401:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788796506.052408:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788796506.052413:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788796506.052416:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd26717a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788796506.052427:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788796506.052431:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959268352:0@lo:8: 00010000:00080000:2.0:1788796506.052459:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27b4faa00 x1875688959268992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796506.052478:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959268992:0@lo:400: 00000004:00080000:1.0:1788796506.052965:0:7927:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788796506.053096:0:7927:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 233034349000ns, next at 0ns, rc = 0 00010000:00010000:3.0:1788796506.053965:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd247d20200/0xdd273c88cfe225db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe225e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796506.054061:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959269248:0@lo:501: 00000100:00100000:3.0:1788796506.054113:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796506.054157:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24667c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788796506.054186:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959268736 00000100:00100000:3.0:1788796506.054193:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959268736 00000100:00100000:3.0:1788796506.054223:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959269120 00000100:00100000:3.0:1788796506.054226:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959269120 00000100:00100000:3.0:1788796506.054238:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959268864 00000100:00100000:3.0:1788796506.054240:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959268864 00000100:00100000:3.0:1788796506.054254:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788796506.054262:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959268736:12345-0@lo:400: 00000100:00100000:3.0:1788796506.054316:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959268736:12345-0@lo:400: Request processed in 55us (2977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796506.054323:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788796506.054339:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788796506.054346:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959269120:12345-0@lo:400: 00000100:00100000:3.0:1788796506.054375:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959269120:12345-0@lo:400: Request processed in 30us (2981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796506.054380:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788796506.054391:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788796506.054397:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959268864:12345-0@lo:400: 00000100:00100000:3.0:1788796506.054431:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959268864:12345-0@lo:400: Request processed in 34us (2982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796506.054437:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788796506.054482:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27b4f9880 x1875688959269120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796506.054508:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959269120:0@lo:400: 00010000:00080000:3.0:1788796506.054523:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27b4fad80 x1875688959268736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796506.054531:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959268736:0@lo:400: 00010000:00080000:3.0:1788796506.054561:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27b4fa300 x1875688959268864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796506.054570:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959268864:0@lo:400: 00000100:00100000:1.0:1788796506.054772:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959269248 00000100:00100000:1.0:1788796506.054785:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959269248 00000100:00100000:1.0:1788796506.054820:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788796506.054827:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959269248:12345-0@lo:501: 00000100:00100000:1.0:1788796506.055061:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959269248:12345-0@lo:501: Request processed in 234us (946us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788796506.055067:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788796506.055595:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959269248:0@lo:501: 10000000:01000000:3.0:1788796506.055629:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788796506.055637:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20200/0xdd273c88cfe225db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe225e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796506.055647:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd247d20200/0xdd273c88cfe225db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe225e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788796506.115149:0:7928:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788796506.115183:0:7928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7928:1875688959269504:0@lo:7: 00000100:00100000:1.0:1788796506.115247:0:7928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796506.115302:0:7928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2467aa780 going to sleep for 11 seconds 00000100:00100000:1.0:1788796506.115318:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788796506.115329:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959269376:0@lo:13: 00000100:00100000:1.0:1788796506.115354:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796506.115383:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959269504 00000100:00100000:1.0:1788796506.115391:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959269504 00000100:00100000:1.0:1788796506.115458:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788796506.115468:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7928:x1875688959269504:12345-0@lo:7: 00000100:00080000:3.0:1788796506.117979:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788796506.124903:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959269376 00000100:00100000:1.0:1788796506.124922:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959269376 00000100:00100000:1.0:1788796506.124987:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788796506.124998:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959269376:12345-0@lo:13: 00002000:00000024:1.0:1788796506.125035:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788796506.125139:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959269376:12345-0@lo:13: Request processed in 142us (9783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796506.125146:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788796506.125200:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd25030c000 x1875688959269376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796506.125242:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959269376:0@lo:13: 00002000:00080000:1.0:1788796506.133678:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788796506.133690:0:6694:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788796506.133809:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7928:x1875688959269504:12345-0@lo:7: Request processed in 18338us (18557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796506.133820:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788796506.134011:0:7928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd25030e680 x1875688959269504/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788796522 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796506.134039:0:7928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7928:1875688959269504:0@lo:7: 00000004:00080000:2.0:1788796506.134053:0:7928:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788796506.134093:0:7928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4faa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7928:1875688959269632:0@lo:5: 00000100:00100000:2.0:1788796506.134129:0:7928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796506.134192:0:7928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2794e70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796506.135312:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959269632 00000100:00100000:1.0:1788796506.135324:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959269632 00000100:00100000:1.0:1788796506.135383:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788796506.135393:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7928:x1875688959269632:12345-0@lo:5: 00002000:00080000:1.0:1788796506.136533:0:6692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788796506.136540:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788796506.136886:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7928:x1875688959269632:12345-0@lo:5: Request processed in 1492us (2754us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788796506.136894:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788796506.137633:0:7928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27b4faa00 x1875688959269632/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788796522 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796506.137650:0:7928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4faa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7928:1875688959269632:0@lo:5: 00000004:00080000:2.0:1788796506.137662:0:7928:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788796506.137701:0:7928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7928:1875688959269760:0@lo:700: 00000100:00100000:2.0:1788796506.137734:0:7928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796506.137791:0:7928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2794e70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796506.138430:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959269760 00000100:00100000:3.0:1788796506.138439:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959269760 00000100:00100000:3.0:1788796506.138487:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788796506.138496:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7928:x1875688959269760:12345-0@lo:700: 00000100:00100000:3.0:1788796506.138534:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6700:1875688959269888:0@lo:700: 00000100:00100000:3.0:1788796506.138568:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796506.138603:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796506.138631:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959269888 00000100:00100000:3.0:1788796506.138642:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959269888 00000100:00100000:3.0:1788796506.138678:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788796506.138685:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6700:x1875688959269888:12345-0@lo:700: 00000004:00080000:3.0:1788796506.171062:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1788796506.232867:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788796506.240235:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6700:x1875688959269888:12345-0@lo:700: Request processed in 101436us (101552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796506.240250:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788796506.240360:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27ead9f80 x1875688959269888/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788796522 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796506.240376:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6700:1875688959269888:0@lo:700: 40000000:02000000:3.0:1788796506.240388:0:6700:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1788796506.402975:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788796506.402993:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788796506.404204:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7928:x1875688959269760:12345-0@lo:700: Request processed in 265702us (266462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796506.404217:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788796506.404375:0:7928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27b4fa300 x1875688959269760/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788796522 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796506.404387:0:7928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788796506.404405:0:7928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7928:1875688959269760:0@lo:700: 00010000:00010000:0.0:1788796506.457894:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:3.0:1788796506.482445:0:7928:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788796506.496153:0:7928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7928:1875688959270016:0@lo:5: 00000100:00100000:0.0:1788796506.496229:0:7928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796506.496289:0:7928:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2673afcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796506.498167:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959270016 00000100:00100000:3.0:1788796506.498182:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959270016 00000100:00100000:3.0:1788796506.498244:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788796506.498254:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7928:x1875688959270016:12345-0@lo:5: 00002000:00080000:3.0:1788796506.521064:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788796506.521086:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788796506.528104:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7928:x1875688959270016:12345-0@lo:5: Request processed in 29845us (31867us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788796506.528118:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788796506.528694:0:7928:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd26c623100 x1875688959270016/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788796522 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796506.528711:0:7928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7928:1875688959270016:0@lo:5: 00000004:00080000:0.0:1788796506.528726:0:7928:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1788796507.493713:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788796507.751683:0:7996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788796507.994918:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796507.994949:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959270144:0@lo:13: 00000100:00100000:3.0:1788796507.995023:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796507.995106:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959270144 00000100:00100000:3.0:1788796507.995119:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959270144 00000100:00100000:3.0:1788796507.995173:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788796507.995182:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959270144:12345-0@lo:13: 00002000:00000024:3.0:1788796507.995218:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796507.995263:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959270144:12345-0@lo:13: Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796507.995271:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788796507.995292:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788796507.995360:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27ead9f80 x1875688959270144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796507.995381:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959270144:0@lo:13: 00010000:00010000:2.0:1788796508.513041:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796509.535778:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796510.554529:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796511.068992:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959270272:0@lo:400: 00000100:00100000:1.0:1788796511.069063:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796511.069108:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875688959270784:0@lo:400: 00000100:00100000:1.0:1788796511.069131:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796511.069155:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788796511.069159:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959270656:0@lo:400: 00000100:00100000:1.0:1788796511.069190:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796511.069214:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959270400:0@lo:400: 00000100:00100000:1.0:1788796511.069232:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796511.069246:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959270912:0@lo:400: 00000100:00100000:1.0:1788796511.069275:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796511.069295:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788796511.069299:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959270528:0@lo:400: 00000100:00100000:1.0:1788796511.069332:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796511.069360:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959270272 00000100:00100000:1.0:1788796511.069368:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959270272 00000100:00100000:1.0:1788796511.069407:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788796511.069414:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3305:x1875688959270272:12345-0@lo:400: 00000100:00100000:1.0:1788796511.069457:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3305:x1875688959270272:12345-0@lo:400: Request processed in 42us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796511.069463:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788796511.069489:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959270784 00000100:00100000:1.0:1788796511.069506:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959270784 00000100:00100000:1.0:1788796511.069533:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959270400 00000100:00100000:1.0:1788796511.069535:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959270400 00000100:00100000:1.0:1788796511.069544:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959270528 00000100:00100000:1.0:1788796511.069546:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959270528 00000100:00100000:1.0:1788796511.069558:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788796511.069564:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875688959270784:12345-0@lo:400: 00000100:00100000:1.0:1788796511.069607:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875688959270784:12345-0@lo:400: Request processed in 43us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796511.069612:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788796511.069624:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788796511.069628:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959270400:12345-0@lo:400: 00000100:00100000:1.0:1788796511.069662:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959270400:12345-0@lo:400: Request processed in 33us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796511.069669:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788796511.069680:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788796511.069685:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959270528:12345-0@lo:400: 00000100:00100000:1.0:1788796511.069709:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959270528:12345-0@lo:400: Request processed in 23us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796511.069715:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788796511.069734:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959270656 00000100:00100000:1.0:1788796511.069737:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959270656 00000100:00100000:1.0:1788796511.069786:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959270912 00000100:00100000:1.0:1788796511.069788:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959270912 00000100:00100000:1.0:1788796511.069802:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788796511.069807:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959270656:12345-0@lo:400: 00000100:00100000:1.0:1788796511.069838:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959270656:12345-0@lo:400: Request processed in 30us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796511.069843:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788796511.069853:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788796511.069858:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875688959270912:12345-0@lo:400: 00000100:00100000:1.0:1788796511.069882:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875688959270912:12345-0@lo:400: Request processed in 24us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796511.069887:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788796511.069911:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788796511.069915:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788796511.069917:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788796511.069948:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd25030ea00 x1875688959270528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796511.069972:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959270528:0@lo:400: 00010000:00080000:1.0:1788796511.069985:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd25030df80 x1875688959270400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796511.069992:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959270400:0@lo:400: 00010000:00080000:1.0:1788796511.070000:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd25030f100 x1875688959270912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796511.070007:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959270912:0@lo:400: 00010000:00080000:1.0:1788796511.070036:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd25030ce00 x1875688959270656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796511.070044:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959270656:0@lo:400: 00000100:00100000:1.0:1788796511.070051:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959270272:0@lo:400: 00010000:00080000:1.0:1788796511.070058:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd25030c700 x1875688959270784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796511.070065:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875688959270784:0@lo:400: 00000100:00100000:0.0:1788796511.583759:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959271040:0@lo:13: 00000100:00100000:0.0:1788796511.584560:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788796511.584633:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796511.584645:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959271040 00000100:00100000:0.0:1788796511.584654:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959271040 00000100:00100000:0.0:1788796511.585595:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788796511.585605:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875688959271040:12345-0@lo:13: 00002000:00000024:0.0:1788796511.585639:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796511.587222:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875688959271040:12345-0@lo:13: Request processed in 1611us (2655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796511.587235:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788796511.588081:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd26c621c00 x1875688959271040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796511.588106:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959271040:0@lo:13: 00000001:00080000:3.0:1788796511.727120:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1788796512.605061:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796513.115044:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788796513.115073:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959271168:0@lo:13: 00000100:00100000:2.0:1788796513.115142:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796513.115389:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959271168 00000100:00100000:3.0:1788796513.115399:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959271168 00000100:00100000:3.0:1788796513.115477:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788796513.115487:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959271168:12345-0@lo:13: 00002000:00000024:3.0:1788796513.115520:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796513.115570:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959271168:12345-0@lo:13: Request processed in 85us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796513.115577:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788796513.115616:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27ead9f80 x1875688959271168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796513.115636:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959271168:0@lo:13: 00000100:00080000:1.0:1788796513.115812:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788796513.625997:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796514.650658:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796514.705399:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796514.705572:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936178048 00000100:00100000:3.0:1788796514.705582:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936178048 00000100:00100000:3.0:1788796514.705634:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 113 00000100:00100000:3.0:1788796514.705659:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2354:x1875688936178048:12345-192.168.201.25@tcp:250: 00010000:00080000:3.0:1788796514.705688:0:5838:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 039faa1e-567a-467b-be0f-2f39bb0eb94e@192.168.201.25@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:3.0:1788796514.705718:0:5838:0:(genops.c:1384:class_connect()) connect: client 039faa1e-567a-467b-be0f-2f39bb0eb94e, cookie 0xdd273c88cfe225f0 00000100:00080000:3.0:1788796514.705879:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9bd27d142000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788796514.705960:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+5:2354:x1875688936178048:12345-192.168.201.25@tcp:250: Request processed in 300us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796514.705968:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 113 00000100:00100000:0.0:1788796514.708859:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796514.709332:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936177920 00000100:00100000:1.0:1788796514.709343:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936177920 00000100:00100000:1.0:1788796514.709404:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:1.0:1788796514.709414:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+5:5585:x1875688936177920:12345-192.168.201.25@tcp:101: 00010000:00010000:1.0:1788796514.709439:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796514.709460:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd282053400/0xdd273c88cfe225f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e7b1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796514.709512:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd282053400/0xdd273c88cfe225f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b1 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796514.709525:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd282053400/0xdd273c88cfe225f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b1 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796514.709534:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd282053400, rc 0) 00000100:00100000:1.0:1788796514.709596:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+6:5585:x1875688936177920:12345-192.168.201.25@tcp:101: Request processed in 184us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796514.709603:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:0.0:1788796514.716139:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796514.716268:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936178176 00000100:00100000:1.0:1788796514.716279:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936178176 00000100:00100000:1.0:1788796514.716338:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:1.0:1788796514.716348:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd249a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+6:5585:x1875688936178176:12345-192.168.201.25@tcp:501: 00000100:00100000:1.0:1788796514.716725:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd249a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+6:5585:x1875688936178176:12345-192.168.201.25@tcp:501: Request processed in 377us (593us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788796514.716734:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:0.0:1788796514.719550:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796514.719797:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936178304 00000100:00100000:3.0:1788796514.719808:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936178304 00000100:00100000:3.0:1788796514.719868:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:3.0:1788796514.719879:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+6:5585:x1875688936178304:12345-192.168.201.25@tcp:101: 00010000:00010000:3.0:1788796514.719895:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796514.719913:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d21000/0xdd273c88cfe225fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e7b8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796514.719941:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d21000/0xdd273c88cfe225fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b8 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796514.719952:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d21000/0xdd273c88cfe225fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b8 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796514.719961:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21000, rc 0) 00000100:00100000:3.0:1788796514.720018:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+7:5585:x1875688936178304:12345-192.168.201.25@tcp:101: Request processed in 141us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796514.720024:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:0.0:1788796514.722241:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796514.723526:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936178432 00000100:00100000:2.0:1788796514.723540:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936178432 00000100:00100000:2.0:1788796514.723930:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00100000:2.0:1788796514.723941:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+7:5585:x1875688936178432:12345-192.168.201.25@tcp:501: 00000100:00100000:2.0:1788796514.724245:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+8:5585:x1875688936178432:12345-192.168.201.25@tcp:501: Request processed in 305us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796514.724253:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00100000:0.0:1788796514.733919:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796514.734011:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936178560 00000100:00100000:2.0:1788796514.734021:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936178560 00000100:00100000:2.0:1788796514.734076:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 118 00000100:00100000:2.0:1788796514.734087:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+8:5585:x1875688936178560:12345-192.168.201.25@tcp:503: 00000100:00100000:2.0:1788796514.734493:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+8:5585:x1875688936178560:12345-192.168.201.25@tcp:503: Request processed in 406us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796514.734502:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 118 00000100:00100000:0.0:1788796514.737737:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796514.738087:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936178688 00000100:00100000:2.0:1788796514.738097:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936178688 00000100:00100000:2.0:1788796514.738150:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 119 00000100:00100000:2.0:1788796514.738160:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+8:5604:x1875688936178688:12345-192.168.201.25@tcp:502: 00000100:00100000:2.0:1788796514.738535:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+8:5604:x1875688936178688:12345-192.168.201.25@tcp:502: Request processed in 375us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796514.738542:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 119 00000100:00100000:0.0:1788796514.766904:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796514.766998:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936178816 00000100:00100000:3.0:1788796514.767008:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936178816 00000100:00100000:3.0:1788796514.767082:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:3.0:1788796514.767091:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+8:5604:x1875688936178816:12345-192.168.201.25@tcp:502: 00000100:00100000:3.0:1788796514.767383:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+8:5604:x1875688936178816:12345-192.168.201.25@tcp:502: Request processed in 291us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796514.767391:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:0.0:1788796514.778951:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796514.779053:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936178944 00000100:00100000:1.0:1788796514.779063:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936178944 00000100:00100000:1.0:1788796514.779116:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:1.0:1788796514.779125:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+8:5585:x1875688936178944:12345-192.168.201.25@tcp:101: 00010000:00010000:1.0:1788796514.779140:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796514.779156:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd282053a00/0xdd273c88cfe22605 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e7e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796514.779183:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd282053a00/0xdd273c88cfe22605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7e2 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796514.779208:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd282053a00/0xdd273c88cfe22605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7e2 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796514.779218:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd282053a00, rc 0) 00000100:00100000:1.0:1788796514.779279:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:5585:x1875688936178944:12345-192.168.201.25@tcp:101: Request processed in 155us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796514.779286:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:0.0:1788796514.787522:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796514.787617:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936179072 00000100:00100000:2.0:1788796514.787653:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936179072 00000100:00100000:2.0:1788796514.787717:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 122 00000100:00100000:2.0:1788796514.787728:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:5585:x1875688936179072:12345-192.168.201.25@tcp:256: 20000000:01000000:2.0:1788796514.787801:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788796514.787819:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788796514.787823:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788796514.787826:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788796514.787829:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788796514.791074:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:5585:x1875688936179072:12345-192.168.201.25@tcp:256: Request processed in 3338us (3552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796514.791085:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 122 00000100:00100000:0.0:1788796514.795656:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796514.795824:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936179200 00000100:00100000:3.0:1788796514.795836:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936179200 00000100:00100000:3.0:1788796514.795895:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 123 00000100:00100000:3.0:1788796514.795905:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:5585:x1875688936179200:12345-192.168.201.25@tcp:101: 00010000:00010000:3.0:1788796514.795922:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796514.795939:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe2260c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e7e9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796514.795969:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe2260c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7e9 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796514.795979:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe2260c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7e9 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796514.795988:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20c00, rc 0) 00000100:00100000:3.0:1788796514.796045:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5585:x1875688936179200:12345-192.168.201.25@tcp:101: Request processed in 141us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796514.796052:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 123 00000100:00100000:0.0:1788796514.798298:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796514.798446:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936179328 00000100:00100000:2.0:1788796514.798456:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936179328 00000100:00100000:2.0:1788796514.798507:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 124 00000100:00100000:2.0:1788796514.798516:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5585:x1875688936179328:12345-192.168.201.25@tcp:501: 00000100:00100000:2.0:1788796514.798834:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5585:x1875688936179328:12345-192.168.201.25@tcp:501: Request processed in 317us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796514.798842:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 124 00000100:00100000:0.0:1788796514.801796:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796514.801928:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936179456 00000100:00100000:1.0:1788796514.801940:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936179456 00000100:00100000:1.0:1788796514.802001:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00100000:1.0:1788796514.802012:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5585:x1875688936179456:12345-192.168.201.25@tcp:503: 00000100:00100000:1.0:1788796514.802454:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5585:x1875688936179456:12345-192.168.201.25@tcp:503: Request processed in 441us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796514.802462:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00100000:0.0:1788796514.806788:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796514.806869:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936179584 00000100:00100000:3.0:1788796514.806880:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936179584 00000100:00100000:3.0:1788796514.806937:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 126 00000100:00100000:3.0:1788796514.806947:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24a490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5607:x1875688936179584:12345-192.168.201.25@tcp:502: 00000100:00100000:3.0:1788796514.807264:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24a490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5607:x1875688936179584:12345-192.168.201.25@tcp:502: Request processed in 316us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796514.807272:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 126 00000100:00100000:0.0:1788796514.813968:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796514.814074:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936179712 00000100:00100000:2.0:1788796514.814085:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936179712 00000100:00100000:2.0:1788796514.814142:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 127 00000100:00100000:2.0:1788796514.814154:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24a493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5607:x1875688936179712:12345-192.168.201.25@tcp:502: 00000100:00100000:2.0:1788796514.814539:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24a493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5607:x1875688936179712:12345-192.168.201.25@tcp:502: Request processed in 386us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796514.814556:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 127 00000100:00100000:0.0:1788796514.819783:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796514.819891:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936179840 00000100:00100000:1.0:1788796514.819902:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936179840 00000100:00100000:1.0:1788796514.819954:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:1.0:1788796514.819962:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2354:x1875688936179840:12345-192.168.201.25@tcp:38: 00010000:00080000:1.0:1788796514.819991:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:1.0:1788796514.820041:0:5846:0:(genops.c:1384:class_connect()) connect: client ad2796a3-2145-47da-88fb-baa43721bec1, cookie 0xdd273c88cfe22613 00000004:00100000:1.0:1788796514.820073:0:5846:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788796514.820080:0:5846:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788796514.920109:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9bd26764f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788796514.920210:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2354:x1875688936179840:12345-192.168.201.25@tcp:38: Request processed in 100246us (100472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796514.920239:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00010000:00010000:0.0:1788796515.673918:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796515.942543:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796515.951933:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796515.955715:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936179968 00000100:00100000:1.0:1788796515.955736:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936179968 00000100:00100000:1.0:1788796515.955848:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936180096 00000100:00100000:1.0:1788796515.955852:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936180096 00000100:00100000:1.0:1788796515.955878:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:1.0:1788796515.955889:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:0:x1875688936179968:12345-192.168.201.25@tcp:41: 00000004:00000024:1.0:1788796515.955943:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788796515.956036:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:0:x1875688936179968:12345-192.168.201.25@tcp:41: Request processed in 148us (13502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796515.956043:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:1.0:1788796515.956063:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:1.0:1788796515.956070:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:5585:x1875688936180096:12345-192.168.201.25@tcp:41: 00000004:00000024:1.0:1788796515.956082:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788796515.956103:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:5585:x1875688936180096:12345-192.168.201.25@tcp:41: Request processed in 34us (4181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796515.956109:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00080000:2.0:1788796515.956401:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796515.963877:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796515.967996:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936180224 00000100:00100000:1.0:1788796515.968012:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936180224 00000100:00100000:2.0:1788796515.978965:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1788796515.978997:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:5585:x1875688936180224:12345-192.168.201.25@tcp:40: 00000100:00100000:2.0:1788796515.979110:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:5585:x1875688936180224:12345-192.168.201.25@tcp:40: Request processed in 117us (15245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796515.979118:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:1.0:1788796515.983185:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796515.983230:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796515.983272:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796515.983456:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936180608 00000100:00100000:2.0:1788796515.983467:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936180608 00000100:00100000:2.0:1788796515.983516:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:2.0:1788796515.983527:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:5585:x1875688936180608:12345-192.168.201.25@tcp:33: 00000100:00100000:1.0:1788796515.984485:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796515.984514:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936180736 00000100:00100000:1.0:1788796515.984521:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936180736 00000100:00100000:1.0:1788796515.984562:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 128 00000100:00100000:1.0:1788796515.984571:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd272493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936180736:12345-192.168.201.25@tcp:400: 00000100:00100000:1.0:1788796515.984657:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd272493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936180736:12345-192.168.201.25@tcp:400: Request processed in 86us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796515.984664:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 128 00000100:00100000:0.0:1788796515.993793:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936180352 00000100:00100000:0.0:1788796515.993810:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936180352 00000100:00100000:0.0:1788796515.993869:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936180480 00000100:00100000:0.0:1788796515.993873:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936180480 00000100:00100000:0.0:1788796515.993892:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1788796515.993901:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1875688936180352:12345-192.168.201.25@tcp:8: 00010000:00080000:0.0:1788796515.993932:0:6694:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:0.0:1788796515.993963:0:6694:0:(genops.c:1384:class_connect()) connect: client ad2796a3-2145-47da-88fb-baa43721bec1, cookie 0xdd273c88cfe2261a 00002000:00100000:0.0:1788796515.993974:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ad2796a3-2145-47da-88fb-baa43721bec1/ffff9bd27ead3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788796515.993997:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788796515.994546:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788796515.994581:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9bd27ead5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788796515.994792:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2354:x1875688936180352:12345-192.168.201.25@tcp:8: Request processed in 890us (11559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796515.994801:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1788796515.994821:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:0.0:1788796515.994826:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1875688936180480:12345-192.168.201.25@tcp:8: 00010000:00080000:0.0:1788796515.994845:0:6694:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:0.0:1788796515.994864:0:6694:0:(genops.c:1384:class_connect()) connect: client ad2796a3-2145-47da-88fb-baa43721bec1, cookie 0xdd273c88cfe22621 00002000:00100000:0.0:1788796515.994871:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ad2796a3-2145-47da-88fb-baa43721bec1/ffff9bd27ead2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788796515.994887:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788796515.995102:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788796515.995119:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9bd27ead2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788796515.995146:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2354:x1875688936180480:12345-192.168.201.25@tcp:8: Request processed in 318us (11873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796515.995153:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000004:00080000:3.0:1788796516.026490:0:5847:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 42897us 00000004:00200000:3.0:1788796516.051995:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788796516.052113:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:5585:x1875688936180608:12345-192.168.201.25@tcp:33: Request processed in 68582us (68931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796516.052127:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:2.0:1788796516.192491:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875688959271552:0@lo:400: 00000100:00100000:2.0:1788796516.192576:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796516.192646:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788796516.192653:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959271424:0@lo:400: 00000100:00100000:2.0:1788796516.192675:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796516.192707:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959271936:0@lo:400: 00000100:00100000:2.0:1788796516.192730:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796516.192792:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959271552 00000100:00100000:2.0:1788796516.192801:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959271552 00000100:00100000:2.0:1788796516.192847:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959271424 00000100:00100000:2.0:1788796516.192850:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959271424 00000100:00100000:2.0:1788796516.192866:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788796516.192873:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875688959271552:12345-0@lo:400: 00000100:00100000:2.0:1788796516.192926:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875688959271552:12345-0@lo:400: Request processed in 53us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796516.192933:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788796516.192953:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788796516.192959:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959271424:12345-0@lo:400: 00000100:00100000:2.0:1788796516.193012:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959271424:12345-0@lo:400: Request processed in 53us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796516.193018:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788796516.193035:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788796516.193062:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27b4faa00 x1875688959271424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796516.193078:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959271424:0@lo:400: 00010000:00080000:2.0:1788796516.193088:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd2671baa00 x1875688959271552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796516.193096:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875688959271552:0@lo:400: 00000100:00100000:1.0:1788796516.193864:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959271680:0@lo:400: 00000100:00100000:1.0:1788796516.193908:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796516.193948:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788796516.193954:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959271296:0@lo:400: 00000100:00100000:1.0:1788796516.193996:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796516.194022:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875688959271808:0@lo:400: 00000100:00100000:1.0:1788796516.194042:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796516.194072:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959271936 00000100:00100000:1.0:1788796516.194078:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959271936 00000100:00100000:1.0:1788796516.194121:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959271680 00000100:00100000:1.0:1788796516.194125:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959271680 00000100:00100000:1.0:1788796516.194143:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788796516.194149:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959271936:12345-0@lo:400: 00000100:00100000:1.0:1788796516.194191:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959271936:12345-0@lo:400: Request processed in 41us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796516.194196:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788796516.194210:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788796516.194215:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959271680:12345-0@lo:400: 00000100:00100000:1.0:1788796516.194258:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959271680:12345-0@lo:400: Request processed in 42us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796516.194263:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788796516.194312:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd2671ba300 x1875688959271680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796516.194340:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959271680:0@lo:400: 00000100:00080000:1.0:1788796516.194358:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788796516.194361:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788796516.194369:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959271808 00000100:00100000:1.0:1788796516.194373:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959271808 00000100:00100000:1.0:1788796516.194399:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788796516.194424:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875688959271808:12345-0@lo:400: 00000100:00100000:1.0:1788796516.194459:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875688959271808:12345-0@lo:400: Request processed in 38us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796516.194465:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788796516.194489:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd2671ba680 x1875688959271808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796516.194498:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875688959271808:0@lo:400: 00000100:00080000:1.0:1788796516.194524:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788796516.194540:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd2671b8e00 x1875688959271936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796516.194547:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788796516.194556:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959271936:0@lo:400: 00000100:00100000:3.0:1788796516.196027:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959271296 00000100:00100000:3.0:1788796516.196040:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959271296 00000100:00100000:3.0:1788796516.196104:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788796516.196114:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd272492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3304:x1875688959271296:12345-0@lo:400: 00000100:00100000:3.0:1788796516.196201:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd272492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3304:x1875688959271296:12345-0@lo:400: Request processed in 89us (2216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796516.196208:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788796516.196454:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959271296:0@lo:400: 00000100:00100000:1.0:1788796516.322064:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796516.322161:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936180864 00000100:00100000:2.0:1788796516.322172:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936180864 00000100:00100000:2.0:1788796516.322244:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:2.0:1788796516.322255:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:5625:x1875688936180864:12345-192.168.201.25@tcp:101: 00010000:00010000:2.0:1788796516.322275:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796516.322302:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152ea00/0xdd273c88cfe22628 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e813 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796516.322384:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe2262f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796516.322408:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe2262f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796516.322424:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe2262f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796516.322476:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788796516.322480:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788796516.322499:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe2262f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796516.322539:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152ea00/0xdd273c88cfe22628 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e813 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796516.322560:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe2262f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e813 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796516.322569:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d573900) 00010000:00010000:2.0:1788796516.322572:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788796516.322576:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd24152fe00, rc 0) 00000100:00100000:2.0:1788796516.322636:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:5625:x1875688936180864:12345-192.168.201.25@tcp:101: Request processed in 383us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796516.322643:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00010000:00010000:2.0:1788796516.698884:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796516.699382:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788796516.699442:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959272064:0@lo:13: 00000100:00100000:2.0:1788796516.699521:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796516.699995:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959272064 00000100:00100000:3.0:1788796516.700003:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959272064 00000100:00100000:3.0:1788796516.700061:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788796516.700070:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959272064:12345-0@lo:13: 00002000:00000024:3.0:1788796516.700089:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796516.700141:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959272064:12345-0@lo:13: Request processed in 72us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796516.700147:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788796516.700290:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd26c623b80 x1875688959272064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796516.700310:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959272064:0@lo:13: 00010000:00010000:0.0:1788796517.728936:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796518.244762:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788796518.244786:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959272192:0@lo:13: 00000100:00100000:2.0:1788796518.244850:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796518.245028:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959272192 00000100:00100000:3.0:1788796518.245037:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959272192 00000100:00100000:3.0:1788796518.245100:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788796518.245112:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959272192:12345-0@lo:13: 00002000:00000024:3.0:1788796518.245159:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796518.245222:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959272192:12345-0@lo:13: Request processed in 113us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796518.245229:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788796518.245267:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27ead9f80 x1875688959272192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796518.245287:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959272192:0@lo:13: 00000100:00080000:1.0:1788796518.245927:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788796518.686671:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796518.686776:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936180992 00000100:00100000:3.0:1788796518.686787:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936180992 00000100:00100000:3.0:1788796518.686865:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1788796518.686876:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+7:5677:x1875688936180992:12345-192.168.201.25@tcp:41: 00000004:00000024:3.0:1788796518.686925:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788796518.687003:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+7:5677:x1875688936180992:12345-192.168.201.25@tcp:41: Request processed in 129us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796518.687010:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00080000:1.0:1788796518.687593:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796518.712702:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796518.712788:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936181120 00000100:00100000:3.0:1788796518.712798:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936181120 00000100:00100000:3.0:1788796518.712916:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:3.0:1788796518.712928:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad2796a3-2145-47da-88fb-baa43721bec1+6:5677:x1875688936181120:12345-192.168.201.25@tcp:13: 00002000:00000024:3.0:1788796518.712959:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796518.713080:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad2796a3-2145-47da-88fb-baa43721bec1+6:5677:x1875688936181120:12345-192.168.201.25@tcp:13: Request processed in 154us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796518.713089:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00080000:1.0:1788796518.713287:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796518.720573:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796518.720770:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936181248 00000100:00100000:2.0:1788796518.720781:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936181248 00000100:00100000:2.0:1788796518.720868:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:2.0:1788796518.720893:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad2796a3-2145-47da-88fb-baa43721bec1+6:5677:x1875688936181248:12345-192.168.201.25@tcp:13: 00002000:00000024:2.0:1788796518.720933:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796518.721022:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad2796a3-2145-47da-88fb-baa43721bec1+6:5677:x1875688936181248:12345-192.168.201.25@tcp:13: Request processed in 131us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796518.721030:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00080000:1.0:1788796518.721104:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788796518.750609:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796519.770846:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788796519.872016:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ad2796a3-2145-47da-88fb-baa43721bec1 00000001:00100000:3.0:1788796519.880434:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad2796a3-2145-47da-88fb-baa43721bec1 00000001:00100000:2.0:1788796520.413271:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ad2796a3-2145-47da-88fb-baa43721bec1 00010000:00010000:2.0:1788796520.793943:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796521.313485:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796521.313514:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959272704:0@lo:400: 00000100:00100000:2.0:1788796521.313569:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796521.313630:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959272448:0@lo:400: 00000100:00100000:1.0:1788796521.313673:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796521.313703:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875688959272576:0@lo:400: 00000100:00100000:1.0:1788796521.313727:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796521.313737:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959272320:0@lo:400: 00000100:00100000:2.0:1788796521.313793:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796521.313805:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959272448 00000100:00100000:1.0:1788796521.313814:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959272448 00000100:00100000:2.0:1788796521.313816:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796521.313821:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875688959272832:0@lo:400: 00000100:00100000:2.0:1788796521.313841:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796521.313855:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959272576 00000100:00100000:1.0:1788796521.313860:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959272576 00000100:00100000:2.0:1788796521.313865:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959272704 00000100:00100000:2.0:1788796521.313869:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959272704 00000100:00100000:1.0:1788796521.313896:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959272832 00000100:00100000:1.0:1788796521.313900:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959272832 00000100:00100000:1.0:1788796521.313921:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788796521.313929:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959272448:12345-0@lo:400: 00000100:00100000:1.0:1788796521.313974:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959272448:12345-0@lo:400: Request processed in 46us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796521.313980:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788796521.314000:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788796521.314005:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875688959272576:12345-0@lo:400: 00000100:00100000:1.0:1788796521.314034:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875688959272576:12345-0@lo:400: Request processed in 28us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796521.314039:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788796521.314051:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788796521.314057:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875688959272832:12345-0@lo:400: 00000100:00100000:1.0:1788796521.314085:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875688959272832:12345-0@lo:400: Request processed in 28us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796521.314090:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788796521.314107:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788796521.314111:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796521.314309:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788796521.314327:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959272704:12345-0@lo:400: 00000100:00100000:2.0:1788796521.314362:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959272704:12345-0@lo:400: Request processed in 38us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796521.314368:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788796521.314398:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959272448:0@lo:400: 00000100:00100000:2.0:1788796521.314405:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959272960:0@lo:400: 00000100:00100000:2.0:1788796521.314438:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796521.314484:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959272320 00000100:00100000:2.0:1788796521.314488:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959272320 00000100:00100000:2.0:1788796521.314526:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788796521.314533:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd272491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3304:x1875688959272320:12345-0@lo:400: 00000100:00100000:2.0:1788796521.314563:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd272491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3304:x1875688959272320:12345-0@lo:400: Request processed in 31us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796521.314568:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788796521.314608:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959272960 00000100:00100000:2.0:1788796521.314612:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959272960 00000100:00100000:2.0:1788796521.314639:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788796521.314645:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959272960:12345-0@lo:400: 00000100:00100000:2.0:1788796521.314676:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959272960:12345-0@lo:400: Request processed in 32us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796521.314681:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788796521.314700:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788796521.314716:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27e3aad80 x1875688959272960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796521.314726:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959272960:0@lo:400: 00000100:00100000:2.0:1788796521.314770:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875688959272832:0@lo:400: 00010000:00080000:2.0:1788796521.314780:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27e3ab480 x1875688959272704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796521.314789:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959272704:0@lo:400: 00000100:00100000:2.0:1788796521.314796:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959272320:0@lo:400: 00000100:00100000:1.0:1788796521.316426:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875688959272576:0@lo:400: 00000100:00100000:1.0:1788796521.373576:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796521.373621:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796521.373647:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796521.373676:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796521.373705:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936181504 00000100:00100000:1.0:1788796521.373714:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936181504 00000100:00100000:1.0:1788796521.373803:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:1.0:1788796521.373813:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936181504:12345-192.168.201.25@tcp:400: 00000100:00100000:1.0:1788796521.373883:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936181504:12345-192.168.201.25@tcp:400: Request processed in 71us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796521.373890:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:1.0:1788796521.373914:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936181632 00000100:00100000:1.0:1788796521.373918:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936181632 00000100:00100000:1.0:1788796521.373944:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936181760 00000100:00100000:1.0:1788796521.373948:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936181760 00000100:00100000:1.0:1788796521.373965:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:1.0:1788796521.373972:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2356:x1875688936181632:12345-192.168.201.25@tcp:400: 00000100:00100000:1.0:1788796521.373998:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2356:x1875688936181632:12345-192.168.201.25@tcp:400: Request processed in 26us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796521.374004:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:1.0:1788796521.374016:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:1.0:1788796521.374022:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2356:x1875688936181760:12345-192.168.201.25@tcp:400: 00000100:00100000:1.0:1788796521.374045:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2356:x1875688936181760:12345-192.168.201.25@tcp:400: Request processed in 23us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796521.374051:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00080000:1.0:1788796521.374067:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788796521.374079:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788796521.374081:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796521.374881:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936181376 00000100:00100000:2.0:1788796521.374889:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936181376 00000100:00100000:2.0:1788796521.374932:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 131 00000100:00100000:2.0:1788796521.374950:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936181376:12345-192.168.201.25@tcp:400: 00000100:00100000:2.0:1788796521.374989:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936181376:12345-192.168.201.25@tcp:400: Request processed in 41us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796521.374996:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 131 00000001:02000400:3.0:1788796521.471352:0:8301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788796521.818529:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796521.818603:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788796521.818624:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959273088:0@lo:13: 00000100:00100000:2.0:1788796521.818695:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796521.819331:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959273088 00000100:00100000:0.0:1788796521.819341:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959273088 00000100:00100000:0.0:1788796521.819409:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788796521.819434:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959273088:12345-0@lo:13: 00002000:00000024:0.0:1788796521.819473:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796521.819534:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959273088:12345-0@lo:13: Request processed in 104us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796521.819541:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788796521.819659:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd26c623100 x1875688959273088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796521.819678:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959273088:0@lo:13: 00010000:00010000:3.0:1788796522.849338:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796523.356644:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788796523.356673:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959273216:0@lo:13: 00000100:00100000:0.0:1788796523.356742:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796523.356844:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959273216 00000100:00100000:0.0:1788796523.356852:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959273216 00000100:00100000:0.0:1788796523.359303:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788796523.359320:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959273216:12345-0@lo:13: 00002000:00000024:0.0:1788796523.359360:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796523.359438:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959273216:12345-0@lo:13: Request processed in 123us (2696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796523.359445:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788796523.359498:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd2671b9180 x1875688959273216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796523.359524:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959273216:0@lo:13: 00000100:00080000:3.0:1788796523.360682:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788796523.874891:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796524.889946:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788796525.381587:0:8450:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd92c5ba60 20000000:00000080:3.0:1788796525.381609:0:8450:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd27d0c3400 uarg=0000000000000000 20000000:01000000:3.0:1788796525.381648:0:8450:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788796525.381651:0:8450:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788796525.381653:0:8450:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788796525.381658:0:8450:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788796525.381664:0:8450:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788796525.381691:0:8450:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788796525.381694:0:8450:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788796525.382593:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788796525.382598:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788796525.391665:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788796525.392441:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788796525.392499:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788796525.392554:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788796525.392567:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788796525.392570:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788796525.396471:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788796525.397385:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788796525.400036:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788796525.400090:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788796525.400111:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788796525.400115:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788796525.404516:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788796525.406050:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788796525.406385:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788796525.406423:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788796525.406513:0:8450:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788796525.406516:0:8450:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788796525.413616:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788796525.417425:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788796525.417514:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788796525.417556:0:8450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1788796525.417582:0:8450:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788796525.417602:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe22636 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.417620:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd240030200/0xdd273c88cfe22533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2252c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.417628:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe2255d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22556 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.417635:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe22587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22580 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.417641:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2258e expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.417647:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe225a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2259c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.417653:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd2821d5600/0xdd273c88cfe225bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe225b8 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.417660:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd247d21400/0xdd273c88cfe225e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe225db expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.417693:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd282053400/0xdd273c88cfe225f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b1 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.417700:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd247d21000/0xdd273c88cfe225fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b8 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.417707:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe22636 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.417771:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd247d21000/0xdd273c88cfe225fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b8 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.417787:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd247d21000/0xdd273c88cfe225fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b8 expref: 9 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796525.417804:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959273344:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796525.418108:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd282053400/0xdd273c88cfe225f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b1 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.418117:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd282053400/0xdd273c88cfe225f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b1 expref: 9 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796525.418126:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959273472:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796525.418158:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd247d21400/0xdd273c88cfe225e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe225db expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.418167:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd247d21400/0xdd273c88cfe225e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe225db expref: 18 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796525.418190:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959273600:0@lo:104: 00000100:00100000:1.0:1788796525.418234:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796525.418279:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd2821d5600/0xdd273c88cfe225bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe225b8 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.418288:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd2821d5600/0xdd273c88cfe225bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe225b8 expref: 18 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796525.418295:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959273728:0@lo:104: 00000100:00100000:1.0:1788796525.418317:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796525.418338:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe225a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe2259c expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.418346:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe225a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe2259c expref: 18 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796525.418354:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959273856:0@lo:104: 00010000:00010000:1.0:1788796525.418377:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe2258e expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.418384:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22595 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe2258e expref: 18 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796525.418391:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959273984:0@lo:104: 00010000:00010000:1.0:1788796525.418620:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe22587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe22580 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.418629:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe22587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe22580 expref: 18 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796525.418644:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959274112:0@lo:104: 00000100:00100000:0.0:1788796525.418645:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788796525.418663:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796525.418685:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796525.418695:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959273600 00000100:00100000:0.0:1788796525.418702:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959273600 00000100:00100000:0.0:1788796525.418740:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959273728 00000100:00100000:0.0:1788796525.418777:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959273728 00000100:00100000:0.0:1788796525.418792:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959273856 00000100:00100000:0.0:1788796525.418800:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959273856 00000100:00100000:0.0:1788796525.418814:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959273984 00000100:00100000:0.0:1788796525.418816:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959273984 00000100:00100000:0.0:1788796525.418828:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788796525.418838:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+6:8450:x1875688959273600:12345-0@lo:104: 00010000:00010000:0.0:1788796525.418862:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd247d20200/0xdd273c88cfe225db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe225e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.418913:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788796525.418919:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+6:8450:x1875688959273600:12345-0@lo:104: Request processed in 83us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796525.418925:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788796525.418942:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788796525.418948:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb37450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+5:8450:x1875688959273728:12345-0@lo:104: 00010000:00010000:0.0:1788796525.418955:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5e00/0xdd273c88cfe225b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe225bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.418983:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788796525.418988:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb37450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+5:8450:x1875688959273728:12345-0@lo:104: Request processed in 41us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796525.418994:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788796525.419044:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788796525.419051:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+4:8450:x1875688959273856:12345-0@lo:104: 00010000:00010000:0.0:1788796525.419059:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2259c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe225a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.419085:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788796525.419090:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+4:8450:x1875688959273856:12345-0@lo:104: Request processed in 40us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796525.419101:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788796525.419115:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788796525.419121:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:8450:x1875688959273984:12345-0@lo:104: 00010000:00010000:0.0:1788796525.419129:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2258e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22595 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796525.419253:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796525.419290:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe2255d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe22556 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.419300:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe2255d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe22556 expref: 18 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796525.419308:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959274240:0@lo:104: 00000100:00100000:1.0:1788796525.419348:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796525.419371:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd240030200/0xdd273c88cfe22533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe2252c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.419378:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd240030200/0xdd273c88cfe22533 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe2252c expref: 18 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796525.419387:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261295500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959274368:0@lo:104: 00000100:00100000:1.0:1788796525.419482:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796525.419496:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26763fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788796525.419520:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959273600:0@lo:104: 00000100:00100000:1.0:1788796525.419528:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959273728:0@lo:104: 00000100:00100000:1.0:1788796525.419535:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959273856:0@lo:104: 00000100:00100000:1.0:1788796525.419540:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959273984:0@lo:104: 00000100:00100000:2.0:1788796525.421330:0:5827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788796525.421345:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1788796525.422311:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788796525.422331:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:8450:x1875688959273984:12345-0@lo:104: Request processed in 3204us (3639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796525.422343:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788796525.422378:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959274112 00000100:00100000:0.0:1788796525.422389:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959274112 00000100:00100000:0.0:1788796525.422420:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959274240 00000100:00100000:0.0:1788796525.422424:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959274240 00000100:00100000:0.0:1788796525.423716:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959274368 00000100:00100000:0.0:1788796525.423731:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959274368 00000100:00100000:0.0:1788796525.423790:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788796525.423800:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+5:8450:x1875688959274112:12345-0@lo:104: 00010000:00010000:0.0:1788796525.423818:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4600/0xdd273c88cfe22580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22587 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.423918:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788796525.423924:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+5:8450:x1875688959274112:12345-0@lo:104: Request processed in 127us (4672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796525.423931:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788796525.423948:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788796525.423956:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261294e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+4:8450:x1875688959274240:12345-0@lo:104: 00010000:00010000:0.0:1788796525.423982:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5000/0xdd273c88cfe22556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe2255d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424012:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788796525.424017:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261294e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+4:8450:x1875688959274240:12345-0@lo:104: Request processed in 63us (4669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796525.424024:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788796525.424038:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788796525.424044:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:8450:x1875688959274368:12345-0@lo:104: 00010000:00010000:0.0:1788796525.424052:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe2252c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22533 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424079:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788796525.424084:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:8450:x1875688959274368:12345-0@lo:104: Request processed in 40us (4603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796525.424089:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788796525.424133:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788796525.424140:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd247d20200/0xdd273c88cfe225db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe225e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424147:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20200 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796525.424151:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd247d20200/0xdd273c88cfe225db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe225e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424159:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd247d20200/0xdd273c88cfe225db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe225e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796525.424166:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd247d20200/0xdd273c88cfe225db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe225e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796525.424180:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796525.424229:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd247d20200/0xdd273c88cfe225db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe225e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424235:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796525.424271:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd247d20200/0xdd273c88cfe225db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe225e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424279:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd247d20200/0xdd273c88cfe225db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe225e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424292:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788796525.424296:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5e00/0xdd273c88cfe225b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe225bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424301:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5e00 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796525.424303:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5e00/0xdd273c88cfe225b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe225bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424310:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5e00/0xdd273c88cfe225b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe225bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796525.424316:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5e00/0xdd273c88cfe225b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe225bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796525.424321:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796525.424333:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5e00/0xdd273c88cfe225b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe225bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424338:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796525.424361:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5e00/0xdd273c88cfe225b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe225bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424368:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5e00/0xdd273c88cfe225b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe225bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424378:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788796525.424381:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2259c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe225a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424388:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152e800 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796525.424391:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2259c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe225a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424397:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2259c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe225a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796525.424405:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2259c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe225a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796525.424410:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796525.424423:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2259c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe225a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424428:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796525.424433:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2259c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe225a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424452:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2259c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe225a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424462:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788796525.424471:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2258e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22595 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424477:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5400 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796525.424480:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2258e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe22595 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424487:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2258e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe22595 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796525.424493:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2258e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe22595 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796525.424498:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796525.424530:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2258e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22595 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424536:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796525.424542:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2258e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22595 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424548:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2258e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22595 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424558:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788796525.424561:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4600/0xdd273c88cfe22580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22587 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424567:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4600 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796525.424569:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4600/0xdd273c88cfe22580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe22587 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424586:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4600/0xdd273c88cfe22580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe22587 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796525.424592:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4600/0xdd273c88cfe22580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe22587 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796525.424597:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796525.424611:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4600/0xdd273c88cfe22580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22587 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424617:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796525.424622:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4600/0xdd273c88cfe22580 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22587 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424627:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4600/0xdd273c88cfe22580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22587 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424636:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788796525.424639:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5000/0xdd273c88cfe22556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe2255d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424644:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5000 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796525.424647:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5000/0xdd273c88cfe22556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe2255d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424653:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5000/0xdd273c88cfe22556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe2255d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796525.424660:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5000/0xdd273c88cfe22556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe2255d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796525.424671:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796525.424685:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5000/0xdd273c88cfe22556 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe2255d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424690:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796525.424694:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5000/0xdd273c88cfe22556 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe2255d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424700:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5000/0xdd273c88cfe22556 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe2255d expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424708:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796525.424711:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe2252c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22533 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424716:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240030c00 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796525.424718:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe2252c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe22533 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424724:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe2252c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe22533 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796525.424729:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe2252c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe22533 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796525.424734:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788796525.424760:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe2252c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22533 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424766:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796525.424778:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe2252c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22533 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424783:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe2252c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22533 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.424796:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796525.424798:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796525.424799:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796525.424809:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959274112:0@lo:104: 00000100:00100000:0.0:1788796525.424821:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959274496:0@lo:103: 00000100:00100000:1.0:1788796525.424829:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959274240:0@lo:104: 00000100:00100000:1.0:1788796525.424837:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261295500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959274368:0@lo:104: 00000100:00100000:0.0:1788796525.424873:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796525.424915:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959275008:0@lo:103: 00000100:00100000:0.0:1788796525.424936:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796525.424958:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788796525.424963:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959274880:0@lo:103: 00000100:00100000:0.0:1788796525.424982:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796525.425008:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959274624:0@lo:103: 00000100:00100000:0.0:1788796525.425030:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796525.425040:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959275136:0@lo:103: 00000100:00100000:0.0:1788796525.425057:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796525.425067:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959274496 00000100:00100000:0.0:1788796525.425068:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788796525.425072:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959274496 00000100:00100000:0.0:1788796525.425072:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959274752:0@lo:103: 00000100:00100000:0.0:1788796525.425089:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796525.425097:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959275264:0@lo:103: 00010000:00010000:1.0:1788796525.425114:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd247d21400/0xdd273c88cfe225e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe225db expref: 19 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796525.425117:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796525.425135:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959275008 00000100:00100000:1.0:1788796525.425137:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959275008 00000100:00100000:0.0:1788796525.425137:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959274880 00000100:00100000:0.0:1788796525.425140:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959274880 00010000:00010000:1.0:1788796525.425150:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe22587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22580 expref: 21 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.425158:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22595 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2258e expref: 21 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796525.425170:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959274624 00000100:00100000:0.0:1788796525.425170:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959275136 00000100:00100000:0.0:1788796525.425173:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959275136 00000100:00100000:1.0:1788796525.425174:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959274624 00010000:00010000:1.0:1788796525.425185:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd2821d5600/0xdd273c88cfe225bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe225b8 expref: 23 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.425185:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe2255d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22556 expref: 23 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796525.425195:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959275264 00000100:00100000:0.0:1788796525.425195:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959274752 00000100:00100000:1.0:1788796525.425197:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959275264 00000100:00100000:0.0:1788796525.425198:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959274752 00010000:00010000:1.0:1788796525.425206:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd240030200/0xdd273c88cfe22533 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2252c expref: 25 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.425206:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe225a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2259c expref: 25 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796525.425218:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788796525.425835:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796525.428170:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f7145a2-0840-45a5-acde-da959fc7802f+25:3305:x1875688959274496:12345-0@lo:103: 00010000:00010000:0.0:1788796525.428205:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796525.428216:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd247d21400/0xdd273c88cfe225e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe225db expref: 25 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.428232:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd247d21400/0xdd273c88cfe225e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe225db expref: 25 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.428262:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d21400/0xdd273c88cfe225e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe225db expref: 25 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.428277:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796525.428359:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f7145a2-0840-45a5-acde-da959fc7802f+24:3305:x1875688959274496:12345-0@lo:103: Request processed in 3133us (3484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796525.428424:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959274496:0@lo:103: 00000100:00100000:2.0:1788796525.428927:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796525.428989:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796525.430011:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788796525.430034:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+24:3305:x1875688959274880:12345-0@lo:103: 00010000:00010000:1.0:1788796525.430055:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796525.430062:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22595 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2258e expref: 24 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796525.430062:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788796525.430075:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe2258e expref: 24 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.430090:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd2821d5200/0xdd273c88cfe22595 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe2258e expref: 23 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.430127:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796525.430154:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788796525.430163:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788796525.430318:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788796525.430327:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936181888 00000100:00100000:0.0:1788796525.430335:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936181888 00010000:00010000:0.0:1788796525.430360:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd247d21000/0xdd273c88cfe225fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b8 expref: 10 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796525.430378:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788796525.430383:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936182016 00000100:00100000:0.0:1788796525.430385:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936182016 00010000:00010000:0.0:1788796525.430396:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd282053400/0xdd273c88cfe225f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b1 expref: 11 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796525.430407:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788796525.430413:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788796525.430419:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+22:3305:x1875688959275008:12345-0@lo:103: 00010000:00010000:0.0:1788796525.430427:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796525.430431:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe22587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22580 expref: 22 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.430504:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe22587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe22580 expref: 22 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.430515:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe22587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe22580 expref: 22 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.430525:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796525.430609:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+21:3305:x1875688959275008:12345-0@lo:103: Request processed in 189us (5670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796525.430616:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788796525.430629:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788796525.430636:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788796525.430650:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+20:3306:x1875688959274624:12345-0@lo:103: 00010000:00010000:0.0:1788796525.430658:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796525.430663:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd2821d5600/0xdd273c88cfe225bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe225b8 expref: 20 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.430671:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd2821d5600/0xdd273c88cfe225bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe225b8 expref: 20 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.430682:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd2821d5600/0xdd273c88cfe225bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe225b8 expref: 20 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.430690:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796525.430721:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959274624:12345-0@lo:103: Request processed in 72us (5690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796525.430727:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788796525.430739:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788796525.430771:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788796525.430779:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+18:3306:x1875688959275136:12345-0@lo:103: 00010000:00010000:0.0:1788796525.430787:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796525.430792:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe2255d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22556 expref: 18 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.430800:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe2255d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe22556 expref: 18 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.430810:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd24152e400/0xdd273c88cfe2255d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe22556 expref: 18 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.430820:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796525.430844:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+17:3306:x1875688959275136:12345-0@lo:103: Request processed in 67us (5786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796525.430954:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788796525.430969:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788796525.430975:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788796525.430982:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+16:3306:x1875688959274752:12345-0@lo:103: 00010000:00010000:0.0:1788796525.430991:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796525.430995:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe225a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2259c expref: 16 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.431003:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe225a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe2259c expref: 16 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.431012:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd24152fc00/0xdd273c88cfe225a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe2259c expref: 16 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.431021:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796525.431046:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+15:3306:x1875688959274752:12345-0@lo:103: Request processed in 65us (5955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796525.431052:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788796525.431063:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788796525.431070:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788796525.431076:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd245992050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+14:3306:x1875688959275264:12345-0@lo:103: 00010000:00010000:0.0:1788796525.431149:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796525.431155:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd240030200/0xdd273c88cfe22533 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2252c expref: 14 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.431164:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd240030200/0xdd273c88cfe22533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe2252c expref: 14 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.431174:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd240030200/0xdd273c88cfe22533 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe2252c expref: 14 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.431189:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796525.431215:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd245992050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+13:3306:x1875688959275264:12345-0@lo:103: Request processed in 139us (6095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796525.431221:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788796525.431232:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788796525.431249:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:0.0:1788796525.431256:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:2358:x1875688936181888:12345-192.168.201.25@tcp:103: 00000100:00100000:1.0:1788796525.431258:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+12:3305:x1875688959274880:12345-0@lo:103: Request processed in 1236us (6275us total) trans 0 rc 0/0 00010000:00010000:0.0:1788796525.431264:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788796525.431265:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1788796525.431268:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd247d21000/0xdd273c88cfe225fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b8 expref: 11 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.431278:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd247d21000/0xdd273c88cfe225fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b8 expref: 11 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796525.431288:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796525.431301:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788796525.431307:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:1.0:1788796525.431313:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:2356:x1875688936182016:12345-192.168.201.25@tcp:103: 00010000:00010000:1.0:1788796525.431319:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796525.431324:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd282053400/0xdd273c88cfe225f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b1 expref: 11 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796525.431326:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:2358:x1875688936181888:12345-192.168.201.25@tcp:103: Request processed in 72us (2404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796525.431333:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00010000:00010000:1.0:1788796525.431334:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd282053400/0xdd273c88cfe225f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b1 expref: 11 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.431346:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe22636 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.431353:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe22636 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.431366:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe22636 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796525.431409:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959274752:0@lo:103: 00000100:00100000:0.0:1788796525.431420:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959275264:0@lo:103: 00000100:00100000:0.0:1788796525.431427:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959274624:0@lo:103: 00000100:00100000:0.0:1788796525.431500:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959275136:0@lo:103: 00010000:00010000:1.0:1788796525.431737:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe22636 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.431762:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe22636 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.431909:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe22636 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.431915:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd282052e00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:1.0:1788796525.431920:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe22636 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.431928:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe22636 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.431938:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe22636 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.431948:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796525.431974:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936182016:12345-192.168.201.25@tcp:103: Request processed in 660us (2984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796525.431986:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00010000:00010000:1.0:1788796525.432027:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d21000/0xdd273c88cfe225fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b8 expref: 9 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796525.432037:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959273344:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796525.432047:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd282053400/0xdd273c88cfe225f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7b1 expref: 8 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796525.432056:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8450:1875688959273472:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796525.432509:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe22636 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.432531:0:8450:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe22636 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.432537:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe22636 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.432543:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe22636 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796525.434215:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959275008:0@lo:103: 00000100:00100000:2.0:1788796525.444709:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959274880:0@lo:103: 00000100:00100000:3.0:1788796525.514075:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796525.521680:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936182144 00000100:00100000:0.0:1788796525.521697:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936182144 00000100:00100000:1.0:1788796525.525539:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 132 00000100:00100000:1.0:1788796525.525555:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+8:5599:x1875688936182144:12345-192.168.201.25@tcp:101: 00010000:00010000:1.0:1788796525.525575:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796525.525598:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe2263d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e81a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.525634:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe2263d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e81a expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.525649:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe2263d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e81a expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.525659:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd282052e00, rc 0) 00000100:00100000:1.0:1788796525.525779:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:5599:x1875688936182144:12345-192.168.201.25@tcp:101: Request processed in 194us (11681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796525.525786:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 132 00000100:00100000:0.0:1788796525.547601:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796525.547702:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936182272 00000100:00100000:1.0:1788796525.547712:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936182272 00000100:00100000:1.0:1788796525.547796:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 133 00000100:00100000:1.0:1788796525.547818:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:5599:x1875688936182272:12345-192.168.201.25@tcp:501: 00000100:00100000:1.0:1788796525.548134:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:5599:x1875688936182272:12345-192.168.201.25@tcp:501: Request processed in 317us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796525.548142:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 133 00000100:00100000:3.0:1788796525.562873:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796525.562954:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936182400 00000100:00100000:1.0:1788796525.562966:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936182400 00000100:00100000:1.0:1788796525.563029:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 134 00000100:00100000:1.0:1788796525.563040:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:5599:x1875688936182400:12345-192.168.201.25@tcp:503: 00000100:00100000:1.0:1788796525.563336:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:5599:x1875688936182400:12345-192.168.201.25@tcp:503: Request processed in 297us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796525.563344:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 134 00000100:00100000:2.0:1788796525.568549:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796525.568699:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936182528 00000100:00100000:0.0:1788796525.568710:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936182528 00000100:00100000:0.0:1788796525.568782:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 135 00000100:00100000:0.0:1788796525.568793:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:6065:x1875688936182528:12345-192.168.201.25@tcp:502: 00000100:00100000:0.0:1788796525.569061:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:6065:x1875688936182528:12345-192.168.201.25@tcp:502: Request processed in 270us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796525.569070:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 135 00000100:00100000:1.0:1788796525.582142:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796525.586234:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936182656 00000100:00100000:3.0:1788796525.586260:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936182656 00000100:00100000:3.0:1788796525.586319:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 136 00000100:00100000:3.0:1788796525.586330:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:6065:x1875688936182656:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788796525.586631:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:6065:x1875688936182656:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 301us (4502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796525.586649:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 136 00000100:00100000:2.0:1788796525.606346:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796525.606421:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936182784 00000100:00100000:1.0:1788796525.606433:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936182784 00000100:00100000:1.0:1788796525.606496:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 137 00000100:00100000:1.0:1788796525.606507:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:5599:x1875688936182784:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796525.606527:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796525.606550:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd282053400/0xdd273c88cfe22644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e821 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.606581:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd282053400/0xdd273c88cfe22644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e821 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.606593:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd282053400/0xdd273c88cfe22644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e821 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796525.606602:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd282053400, rc 0) 00000100:00100000:1.0:1788796525.606684:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5599:x1875688936182784:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 178us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796525.606691:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 137 00000100:00100000:1.0:1788796525.622023:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796525.624292:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936182912 00000100:00100000:3.0:1788796525.624311:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936182912 00000100:00100000:3.0:1788796525.624389:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 138 00000100:00100000:3.0:1788796525.624401:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5599:x1875688936182912:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796525.646252:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5599:x1875688936182912:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 21831us (24217us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788796525.646270:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 138 00010000:00010000:3.0:1788796525.914583:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796526.430926:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959275392:0@lo:400: 00000100:00100000:0.0:1788796526.431004:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.431129:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959275392 00000100:00100000:2.0:1788796526.431138:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959275392 00000100:00100000:2.0:1788796526.431190:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788796526.431199:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:3304:x1875688959275392:12345-0@lo:400: 00000100:00100000:2.0:1788796526.433795:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:3304:x1875688959275392:12345-0@lo:400: Request processed in 2587us (2780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.433810:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788796526.433874:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959275520:0@lo:400: 00000100:00100000:2.0:1788796526.433921:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796526.434305:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959275392:0@lo:400: 00000100:00100000:1.0:1788796526.434676:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959275520 00000100:00100000:1.0:1788796526.434685:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959275520 00000100:00100000:1.0:1788796526.434738:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788796526.434768:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959275520:12345-0@lo:400: 00000100:00100000:1.0:1788796526.434830:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959275520:12345-0@lo:400: Request processed in 84us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796526.434837:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788796526.434870:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959275520:0@lo:400: 00000100:00100000:0.0:1788796526.435387:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959275648:0@lo:400: 00000100:00100000:0.0:1788796526.435422:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796526.436674:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959275648 00000100:00100000:1.0:1788796526.436686:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959275648 00000100:00100000:1.0:1788796526.436740:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788796526.436767:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959275648:12345-0@lo:400: 00000100:00100000:1.0:1788796526.441410:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959275648:12345-0@lo:400: Request processed in 4636us (5977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796526.441501:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788796526.442689:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875688959275904:0@lo:400: 00000100:00100000:2.0:1788796526.442768:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796526.443568:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959276032:0@lo:400: 00000100:00100000:1.0:1788796526.443608:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796526.443652:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959276032 00000100:00100000:1.0:1788796526.443660:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959276032 00000100:00100000:1.0:1788796526.443709:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788796526.443718:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959276032:12345-0@lo:400: 00000100:00100000:1.0:1788796526.443787:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959276032:12345-0@lo:400: Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796526.443803:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788796526.443842:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27eada680 x1875688959276032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796526.443854:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959276032:0@lo:400: 00000100:00100000:2.0:1788796526.444211:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959275904 00000100:00100000:2.0:1788796526.444216:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959275904 00000100:00100000:2.0:1788796526.444271:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788796526.444280:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875688959275904:12345-0@lo:400: 00000100:00100000:2.0:1788796526.444326:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875688959275904:12345-0@lo:400: Request processed in 47us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.444332:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788796526.444360:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875688959275904:0@lo:400: 00000100:00080000:3.0:1788796526.444673:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788796526.444679:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796526.444692:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959275776:0@lo:400: 00000100:00100000:3.0:1788796526.444726:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796526.447097:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959275648:0@lo:400: 00000100:00100000:2.0:1788796526.449971:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959275776 00000100:00100000:2.0:1788796526.449987:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959275776 00000100:00100000:2.0:1788796526.450344:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788796526.450355:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959275776:12345-0@lo:400: 00000100:00100000:2.0:1788796526.450736:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959275776:12345-0@lo:400: Request processed in 382us (6007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.450764:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788796526.450828:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788796526.450900:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27eadaa00 x1875688959275776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796526.450916:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959275776:0@lo:400: 00000100:00100000:2.0:1788796526.470635:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796526.470677:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796526.470716:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796526.470765:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936183296 00000100:00100000:2.0:1788796526.470776:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936183296 00000100:00100000:2.0:1788796526.470834:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936183168 00000100:00100000:2.0:1788796526.470837:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936183168 00000100:00100000:2.0:1788796526.470857:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:2.0:1788796526.470867:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2355:x1875688936183296:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796526.470942:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2355:x1875688936183296:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 77us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.470949:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:2.0:1788796526.470967:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:2.0:1788796526.470973:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2355:x1875688936183168:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796526.470998:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2355:x1875688936183168:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 25us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.471004:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00080000:2.0:1788796526.471021:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788796526.471040:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788796526.471169:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936183040 00000100:00100000:1.0:1788796526.471174:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936183040 00000100:00100000:1.0:1788796526.471210:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:1.0:1788796526.471218:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2355:x1875688936183040:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796526.471262:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2355:x1875688936183040:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 46us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796526.471269:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00080000:2.0:1788796526.471468:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1788796526.577167:0:8506:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7f596bd0 20000000:00000080:0.0:1788796526.577186:0:8506:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd247cf0400 uarg=0000000000000000 20000000:01000000:0.0:1788796526.577784:0:8506:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788796526.577791:0:8506:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788796526.577797:0:8506:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788796526.578665:0:8507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788796526.578939:0:8506:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788796526.587047:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788796526.587123:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788796526.587186:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788796526.587290:0:8506:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788796526.587311:0:8506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd24152ea00/0xdd273c88cfe2264b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.587330:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd240030400/0xdd273c88cfe22422 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2241b expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.587338:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd2821d4800/0xdd273c88cfe22484 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2247d expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.587345:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe2254f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22548 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.587354:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe2260c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7e9 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.587361:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd24152ea00/0xdd273c88cfe2264b lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.587403:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe2260c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7e9 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.587493:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe2260c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7e9 expref: 9 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.587511:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671ba680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875688959276160:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796526.587624:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe2254f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe22548 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.587633:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe2254f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe22548 expref: 11 pid: 5839 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.587655:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671ba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875688959276288:0@lo:104: 00000100:00100000:2.0:1788796526.587698:0:8506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788796526.587774:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd2821d4800/0xdd273c88cfe22484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe2247d expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.587783:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd2821d4800/0xdd273c88cfe22484 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe2247d expref: 11 pid: 5839 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.587792:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875688959276416:0@lo:104: 00000100:00100000:2.0:1788796526.587818:0:8506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.587856:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788796526.587868:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959276288 00000100:00100000:2.0:1788796526.587875:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959276288 00000100:00100000:2.0:1788796526.587921:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959276416 00000100:00100000:2.0:1788796526.587924:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959276416 00000100:00100000:2.0:1788796526.587939:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788796526.587947:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f7145a2-0840-45a5-acde-da959fc7802f+4:8506:x1875688959276288:12345-0@lo:104: 00010000:00010000:2.0:1788796526.587958:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd282052a00/0xdd273c88cfe22548 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe2254f expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.588005:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788796526.588011:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f7145a2-0840-45a5-acde-da959fc7802f+4:8506:x1875688959276288:12345-0@lo:104: Request processed in 66us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.588018:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788796526.588037:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788796526.588043:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f7145a2-0840-45a5-acde-da959fc7802f+3:8506:x1875688959276416:12345-0@lo:104: 00010000:00010000:2.0:1788796526.588051:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe2247d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22484 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.588091:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788796526.588096:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f7145a2-0840-45a5-acde-da959fc7802f+3:8506:x1875688959276416:12345-0@lo:104: Request processed in 54us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.588102:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1788796526.588154:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd240030400/0xdd273c88cfe22422 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe2241b expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.588162:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd240030400/0xdd273c88cfe22422 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe2241b expref: 11 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.588169:0:8506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c620a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875688959276544:0@lo:104: 00000100:00100000:2.0:1788796526.588191:0:8506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.588211:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959276544 00000100:00100000:2.0:1788796526.588214:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959276544 00010000:00010000:3.0:1788796526.588566:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788796526.588574:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd282052a00/0xdd273c88cfe22548 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe2254f expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.588582:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd282052a00 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:3.0:1788796526.588587:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd282052a00/0xdd273c88cfe22548 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe2254f expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.588596:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd282052a00/0xdd273c88cfe22548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe2254f expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788796526.588603:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd282052a00/0xdd273c88cfe22548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe2254f expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796526.588622:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788796526.588661:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd282052a00/0xdd273c88cfe22548 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe2254f expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.588667:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788796526.588688:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd282052a00/0xdd273c88cfe22548 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe2254f expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.588695:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd282052a00/0xdd273c88cfe22548 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe2254f expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.588709:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796526.588712:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe2247d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22484 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.588717:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031600 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:3.0:1788796526.588719:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe2247d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe22484 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.588725:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe2247d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe22484 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788796526.588731:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe2247d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe22484 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796526.588736:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788796526.588772:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe2247d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22484 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.588778:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788796526.588790:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe2247d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22484 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.588796:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe2247d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22484 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.588806:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796526.588808:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796526.588810:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796526.588816:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796526.588940:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959276800:0@lo:103: 00000100:00100000:1.0:1788796526.588977:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796526.589026:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788796526.589032:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959276672:0@lo:103: 00000100:00100000:1.0:1788796526.589053:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796526.589087:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959276800 00000100:00100000:1.0:1788796526.589092:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959276800 00010000:00010000:1.0:1788796526.589113:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd2821d4800/0xdd273c88cfe22484 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2247d expref: 12 pid: 5839 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796526.589135:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959276672 00000100:00100000:1.0:1788796526.589145:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959276672 00010000:00010000:1.0:1788796526.589159:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe2254f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22548 expref: 13 pid: 5839 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796526.589178:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788796526.589185:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+13:3307:x1875688959276800:12345-0@lo:103: 00010000:00010000:1.0:1788796526.589195:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796526.589201:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd2821d4800/0xdd273c88cfe22484 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2247d expref: 13 pid: 5839 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.589210:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd2821d4800/0xdd273c88cfe22484 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe2247d expref: 13 pid: 5839 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.589238:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796526.589271:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+13:3307:x1875688959276800:12345-0@lo:103: Request processed in 87us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796526.589276:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788796526.589292:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788796526.589298:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261295c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+12:3307:x1875688959276672:12345-0@lo:103: 00010000:00010000:1.0:1788796526.589306:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796526.589310:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe2254f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22548 expref: 12 pid: 5839 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.589318:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe2254f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe22548 expref: 12 pid: 5839 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.589327:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796526.589349:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261295c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+12:3307:x1875688959276672:12345-0@lo:103: Request processed in 51us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796526.589354:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788796526.589394:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959276672:0@lo:103: 00000100:00100000:1.0:1788796526.589403:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959276800:0@lo:103: 00000100:00100000:2.0:1788796526.590792:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788796526.590803:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f7145a2-0840-45a5-acde-da959fc7802f+3:8506:x1875688959276544:12345-0@lo:104: 00010000:00010000:2.0:1788796526.590818:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd282052200/0xdd273c88cfe2241b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22422 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.590879:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788796526.590884:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7f7145a2-0840-45a5-acde-da959fc7802f+3:8506:x1875688959276544:12345-0@lo:104: Request processed in 85us (2694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.590890:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788796526.590932:0:8506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249fd9240 going to sleep for 11 seconds 00010000:00010000:2.0:1788796526.590957:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd240031e00/0xdd273c88cfe2254f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe22548 expref: 11 pid: 5839 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.590970:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671ba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875688959276288:0@lo:104: 00010000:00010000:2.0:1788796526.590996:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd2821d4800/0xdd273c88cfe22484 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe2247d expref: 10 pid: 5839 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.591004:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875688959276416:0@lo:104: 00000100:00100000:2.0:1788796526.591011:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c620a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875688959276544:0@lo:104: 00010000:00010000:2.0:1788796526.593267:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796526.593278:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd282052200/0xdd273c88cfe2241b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22422 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.593287:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd282052200 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:2.0:1788796526.593291:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd282052200/0xdd273c88cfe2241b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe22422 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.593301:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd282052200/0xdd273c88cfe2241b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe22422 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796526.593309:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd282052200/0xdd273c88cfe2241b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe22422 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796526.593315:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788796526.593373:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd282052200/0xdd273c88cfe2241b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22422 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.593380:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796526.593409:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd282052200/0xdd273c88cfe2241b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22422 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796526.593533:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788796526.593556:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959276928:0@lo:103: 00000100:00100000:1.0:1788796526.593619:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796526.593686:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959276928 00000100:00100000:1.0:1788796526.593694:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959276928 00010000:00010000:1.0:1788796526.593725:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd240030400/0xdd273c88cfe22422 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2241b expref: 10 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796526.593783:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788796526.593792:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+10:3305:x1875688959276928:12345-0@lo:103: 00010000:00010000:1.0:1788796526.593804:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796526.593810:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd240030400/0xdd273c88cfe22422 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2241b expref: 10 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.593819:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd240030400/0xdd273c88cfe22422 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe2241b expref: 10 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.593834:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd240030400/0xdd273c88cfe22422 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe2241b expref: 10 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.593848:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796526.593882:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+9:3305:x1875688959276928:12345-0@lo:103: Request processed in 92us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796526.593889:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788796526.593932:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959276928:0@lo:103: 00010000:00010000:2.0:1788796526.594045:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd282052200/0xdd273c88cfe2241b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22422 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.594090:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796526.594092:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796526.594093:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796526.595409:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796526.595529:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936183424 00000100:00100000:1.0:1788796526.595549:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936183424 00010000:00010000:1.0:1788796526.595578:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe2260c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7e9 expref: 10 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796526.595614:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:1.0:1788796526.595623:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2357:x1875688936183424:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788796526.595634:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796526.595640:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe2260c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7e9 expref: 10 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.595651:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe2260c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7e9 expref: 10 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.595670:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd24152ea00/0xdd273c88cfe2264b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.595677:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd24152ea00/0xdd273c88cfe2264b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.595692:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd24152ea00/0xdd273c88cfe2264b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.595699:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd24152ea00/0xdd273c88cfe2264b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.595706:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd24152ea00/0xdd273c88cfe2264b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.595712:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd24152ea00/0xdd273c88cfe2264b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.595717:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152ea00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:1.0:1788796526.595727:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd24152ea00/0xdd273c88cfe2264b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.595735:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd24152ea00/0xdd273c88cfe2264b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.595773:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd24152ea00/0xdd273c88cfe2264b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.595784:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796526.595836:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2357:x1875688936183424:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 214us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796526.595843:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00010000:00010000:2.0:1788796526.597120:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe2260c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7e9 expref: 9 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.597140:0:8506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671ba680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1875688959276160:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796526.597179:0:8506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd24152ea00/0xdd273c88cfe2264b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.597189:0:8506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd24152ea00/0xdd273c88cfe2264b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.597195:0:8506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd24152ea00/0xdd273c88cfe2264b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.597201:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd24152ea00/0xdd273c88cfe2264b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796526.882515:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788796526.882522:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd26717e800 from 39 10000000:01000000:2.0:1788796526.882526:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788796526.882574:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.882587:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.882599:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.882636:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c620a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959277056:0@lo:101: 00000100:00100000:2.0:1788796526.882706:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.883268:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249fd9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788796526.883278:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959277056 00000100:00100000:0.0:1788796526.883288:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959277056 00000100:00100000:0.0:1788796526.883343:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788796526.883353:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+9:5841:x1875688959277056:12345-0@lo:101: 00010000:00010000:0.0:1788796526.883366:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796526.883388:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd240030800/0xdd273c88cfe22659 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe22652 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796526.883425:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd240030800/0xdd273c88cfe22659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe22652 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796526.883437:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd240030800/0xdd273c88cfe22659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22652 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796526.883447:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240030800, rc 0) 00000100:00100000:0.0:1788796526.883502:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+10:5841:x1875688959277056:12345-0@lo:101: Request processed in 150us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796526.883508:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788796526.883588:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c620a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959277056:0@lo:101: 00010000:00010000:2.0:1788796526.883603:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22659 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.883613:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22659 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.883681:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c620a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959277184:0@lo:501: 00000100:00100000:2.0:1788796526.883714:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.883869:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249fd9240 going to sleep for 11 seconds 00000100:00100000:3.0:1788796526.883903:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959277184 00000100:00100000:3.0:1788796526.883909:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959277184 00000100:00100000:3.0:1788796526.883977:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788796526.883988:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+10:5841:x1875688959277184:12345-0@lo:501: 00000100:00100000:3.0:1788796526.884442:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+10:5841:x1875688959277184:12345-0@lo:501: Request processed in 457us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796526.884450:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788796526.884630:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c620a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959277184:0@lo:501: 00000100:00100000:1.0:1788796526.884670:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261294380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959277312:0@lo:503: 00000100:00100000:1.0:1788796526.884714:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796526.884773:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26763f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.885631:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959277312 00000100:00100000:2.0:1788796526.885641:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959277312 00000100:00100000:2.0:1788796526.885696:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788796526.885704:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+10:5841:x1875688959277312:12345-0@lo:503: 00000100:00100000:2.0:1788796526.885926:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+10:5841:x1875688959277312:12345-0@lo:503: Request processed in 222us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.885933:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788796526.885992:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261294380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959277312:0@lo:503: 00000100:00100000:2.0:1788796526.886236:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8518:1875688959277440:0@lo:502: 00000100:00100000:2.0:1788796526.886273:0:8518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.886703:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959277440 00000100:00100000:2.0:1788796526.886709:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959277440 00000100:00100000:2.0:1788796526.886743:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788796526.886772:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+10:8518:x1875688959277440:12345-0@lo:502: 00000100:00100000:2.0:1788796526.886958:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+10:8518:x1875688959277440:12345-0@lo:502: Request processed in 186us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.886965:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788796526.887000:0:8518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249fd90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.887014:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8518:1875688959277440:0@lo:502: 00000100:00100000:2.0:1788796526.887305:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8518:1875688959277568:0@lo:502: 00000100:00100000:2.0:1788796526.887343:0:8518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.888367:0:8518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249fd90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796526.888889:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959277568 00000100:00100000:3.0:1788796526.888901:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959277568 00000100:00100000:3.0:1788796526.888955:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788796526.888965:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+10:8518:x1875688959277568:12345-0@lo:502: 00000100:00100000:3.0:1788796526.889264:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+10:8518:x1875688959277568:12345-0@lo:502: Request processed in 299us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796526.889271:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788796526.889940:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8518:1875688959277568:0@lo:502: 00000040:00080000:2.0:1788796526.889979:0:8518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788796526.890289:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788796526.890315:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788796526.890325:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22659 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.890348:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22659 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796526.890357:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788796526.890359:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788796526.890362:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788796526.890392:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.890410:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.890420:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796526.890439:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eadbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959277696:0@lo:101: 00000100:00100000:3.0:1788796526.890483:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796526.890521:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14540 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.890614:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959277696 00000100:00100000:2.0:1788796526.890622:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959277696 00000100:00100000:2.0:1788796526.890663:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788796526.890671:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+10:5841:x1875688959277696:12345-0@lo:101: 00010000:00010000:2.0:1788796526.890681:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796526.890693:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd24152f800/0xdd273c88cfe22667 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe22660 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.890714:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd24152f800/0xdd273c88cfe22667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe22660 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.890724:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd24152f800/0xdd273c88cfe22667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22660 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.890731:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd24152f800, rc 0) 00000100:00100000:2.0:1788796526.890806:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:5841:x1875688959277696:12345-0@lo:101: Request processed in 136us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.890812:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788796526.890901:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eadbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959277696:0@lo:101: 00010000:00010000:3.0:1788796526.890914:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22667 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.890924:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22667 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796526.890966:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eadbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959277824:0@lo:501: 00000100:00100000:3.0:1788796526.890990:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796526.891026:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14540 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.891073:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959277824 00000100:00100000:2.0:1788796526.891077:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959277824 00000100:00100000:2.0:1788796526.891107:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788796526.891113:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:5841:x1875688959277824:12345-0@lo:501: 00000100:00100000:2.0:1788796526.891378:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:5841:x1875688959277824:12345-0@lo:501: Request processed in 265us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.891385:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788796526.891589:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eadbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959277824:0@lo:501: 00000100:00100000:3.0:1788796526.891618:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eadbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959277952:0@lo:503: 00000100:00100000:3.0:1788796526.891661:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796526.891688:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14540 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.891735:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959277952 00000100:00100000:2.0:1788796526.891740:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959277952 00000100:00100000:2.0:1788796526.891792:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788796526.891799:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:5841:x1875688959277952:12345-0@lo:503: 00000100:00100000:2.0:1788796526.891945:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:5841:x1875688959277952:12345-0@lo:503: Request processed in 146us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.891952:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788796526.892044:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eadbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959277952:0@lo:503: 00000100:00100000:3.0:1788796526.892499:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eadbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8519:1875688959278080:0@lo:502: 00000100:00100000:3.0:1788796526.892534:0:8519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796526.892592:0:8519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14240 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.893343:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959278080 00000100:00100000:2.0:1788796526.893351:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959278080 00000100:00100000:2.0:1788796526.893555:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788796526.893565:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:8519:x1875688959278080:12345-0@lo:502: 00000100:00100000:2.0:1788796526.893811:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:8519:x1875688959278080:12345-0@lo:502: Request processed in 248us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.893818:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788796526.894005:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eadbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8519:1875688959278080:0@lo:502: 00000020:01000000:3.0:1788796526.894034:0:8519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796526.894043:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796526.894046:0:8519:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788796526.894051:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788796526.894151:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eadbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8519:1875688959278208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796526.894188:0:8519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796526.894257:0:8519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14240 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.894289:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959278208 00000100:00100000:2.0:1788796526.894295:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959278208 00000100:00100000:2.0:1788796526.894362:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788796526.894372:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:8519:x1875688959278208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796526.894657:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+11:8519:x1875688959278208:12345-0@lo:502:llog_process_th.0 Request processed in 285us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.894664:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788796526.894831:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eadbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8519:1875688959278208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788796526.894853:0:8519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796526.894859:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796526.894861:0:8519:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788796526.894866:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788796526.896892:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788796526.896933:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788796526.896944:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22667 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.896956:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22667 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796526.896964:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788796526.896967:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd26717e800 from 4 10000000:01000000:2.0:1788796526.896969:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788796526.897004:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe2266e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.897012:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe2266e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.897022:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe2266e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.897044:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959278336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.899828:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.899872:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48480 going to sleep for 11 seconds 00000100:00100000:3.0:1788796526.901552:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959278336 00000100:00100000:3.0:1788796526.901566:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959278336 00000100:00100000:3.0:1788796526.901620:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788796526.901629:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+11:5841:x1875688959278336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796526.901660:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796526.901680:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe22675 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2266e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.901706:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe22675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2266e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.901715:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe22675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2266e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796526.901723:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21a00, rc 0) 00000100:00100000:3.0:1788796526.901803:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:5841:x1875688959278336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796526.901811:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788796526.916573:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959278336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796526.916596:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe2266e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22675 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.916614:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe2266e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22675 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.916680:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959278464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.916724:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.916770:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48480 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.916788:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959278464 00000100:00100000:2.0:1788796526.916794:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959278464 00000100:00100000:2.0:1788796526.916837:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788796526.916845:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:5841:x1875688959278464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.917036:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:5841:x1875688959278464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.917042:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788796526.917072:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959278464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.917098:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959278592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.917133:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.917144:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48480 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.917153:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959278592 00000100:00100000:2.0:1788796526.917156:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959278592 00000100:00100000:2.0:1788796526.917170:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788796526.917174:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:5841:x1875688959278592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.917331:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:5841:x1875688959278592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.917336:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788796526.917369:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959278592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.917551:0:8521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8521:1875688959278720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796526.917577:0:8521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.917591:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959278720 00000100:00100000:2.0:1788796526.917594:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959278720 00000100:00100000:2.0:1788796526.917609:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788796526.917613:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:8521:x1875688959278720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796526.917697:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+12:8521:x1875688959278720:12345-0@lo:502:llog_process_th.0 Request processed in 83us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.917702:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788796526.917724:0:8521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.917733:0:8521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8521:1875688959278720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788796526.917769:0:8521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796526.917778:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796526.917780:0:8521:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788796526.917787:0:8521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd26717e800 00000020:00000080:2.0:1788796526.917789:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788796526.917846:0:8521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8521:1875688959278848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796526.917869:0:8521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.917882:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959278848 00000100:00100000:2.0:1788796526.917884:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959278848 00000100:00100000:2.0:1788796526.917897:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788796526.917901:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+12:8521:x1875688959278848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796526.919165:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+12:8521:x1875688959278848:12345-0@lo:502:llog_process_th.0 Request processed in 1259us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.919172:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788796526.919235:0:8521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.919255:0:8521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8521:1875688959278848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788796526.919280:0:8521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796526.919286:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796526.919287:0:8521:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788796526.919290:0:8521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788796526.919348:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788796526.919368:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788796526.919376:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe2266e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22675 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.919388:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe2266e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22675 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796526.919398:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788796526.919411:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd2467d7000 from 39 10000000:01000000:2.0:1788796526.919415:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788796526.919443:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.919451:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.919458:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.919473:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959278976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.919499:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.919514:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.919525:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959278976 00000100:00100000:2.0:1788796526.919535:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959278976 00000100:00100000:2.0:1788796526.919558:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788796526.919563:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+12:5841:x1875688959278976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796526.919571:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796526.919581:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd24152e000/0xdd273c88cfe22683 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2267c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.919596:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd24152e000/0xdd273c88cfe22683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2267c expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.919604:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd24152e000/0xdd273c88cfe22683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2267c expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.919609:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd24152e000, rc 0) 00000100:00100000:2.0:1788796526.919630:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:5841:x1875688959278976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 67us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.919634:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788796526.919654:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959278976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796526.919662:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22683 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.919668:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22683 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.919698:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959279104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.919713:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.919722:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.919730:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959279104 00000100:00100000:2.0:1788796526.919737:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959279104 00000100:00100000:2.0:1788796526.919769:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788796526.919775:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+13:5841:x1875688959279104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.919945:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+13:5841:x1875688959279104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.919950:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788796526.919971:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959279104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.919990:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959279232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.920014:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.920023:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.920031:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959279232 00000100:00100000:2.0:1788796526.920033:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959279232 00000100:00100000:2.0:1788796526.920047:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788796526.920050:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+13:5841:x1875688959279232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.920161:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+13:5841:x1875688959279232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.920167:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788796526.920201:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959279232:0@lo:503:ll_cfg_requeue.0 00010000:00010000:0.0:1788796526.942769:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796526.945718:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959279360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796526.945843:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796526.946136:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261295180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8522:1875688959279488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796526.946188:0:8522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796526.946236:0:8522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26763f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788796526.947607:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959279360 00000100:00100000:0.0:1788796526.947620:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959279360 00000100:00100000:0.0:1788796526.947881:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788796526.947893:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959279360:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796526.949090:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959279488 00000100:00100000:2.0:1788796526.949101:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959279488 00000100:00100000:2.0:1788796526.949138:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788796526.949145:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:8522:x1875688959279488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796526.949435:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:8522:x1875688959279488:12345-0@lo:502:llog_process_th.0 Request processed in 289us (3246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.949444:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00002000:00000024:0.0:1788796526.950942:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796526.951037:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261295180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8522:1875688959279488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796526.951062:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959279360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3170us (5217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796526.951072:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788796526.951129:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd261297100 x1875688959279360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796526.951132:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261295180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8522:1875688959279616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796526.951158:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959279360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796526.951191:0:8522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796526.951718:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959279616 00000100:00100000:1.0:1788796526.951734:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959279616 00000100:00100000:1.0:1788796526.951804:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788796526.951813:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+13:8522:x1875688959279616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796526.955606:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+13:8522:x1875688959279616:12345-0@lo:502:llog_process_th.0 Request processed in 3785us (4407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796526.955620:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788796526.955696:0:8522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26763f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788796526.955722:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261295180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8522:1875688959279616:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788796526.955778:0:8522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:1.0:1788796526.956454:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796526.956487:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936183552 00000100:00100000:1.0:1788796526.956494:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936183552 00000100:00100000:1.0:1788796526.956539:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 160 00000100:00100000:1.0:1788796526.956550:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:5599:x1875688936183552:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796526.956564:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796526.956583:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd282052200/0xdd273c88cfe2268a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e828 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.956611:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd282052200/0xdd273c88cfe2268a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e828 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.956623:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd282052200/0xdd273c88cfe2268a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e828 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.956632:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd282052200, rc 0) 00000100:00100000:1.0:1788796526.956684:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5599:x1875688936183552:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 136us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796526.956706:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 160 00000020:01000000:2.0:1788796526.958378:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788796526.958430:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788796526.958440:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22683 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.958452:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22683 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796526.958462:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788796526.958465:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788796526.958468:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788796526.958504:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.958512:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.958522:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.958545:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959279744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.958609:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.958647:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48480 going to sleep for 11 seconds 00000100:00100000:1.0:1788796526.971459:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959279744 00000100:00100000:1.0:1788796526.971477:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959279744 00000100:00100000:1.0:1788796526.971545:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788796526.971556:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+13:5841:x1875688959279744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796526.971575:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796526.971594:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd282052a00/0xdd273c88cfe22698 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe22691 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.971623:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd282052a00/0xdd273c88cfe22698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe22691 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.971635:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd282052a00/0xdd273c88cfe22698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22691 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796526.971645:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd282052a00, rc 0) 00000100:00100000:1.0:1788796526.971738:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959279744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (13127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796526.971762:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788796526.972565:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959279744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796526.972585:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22698 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.972596:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22698 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.972684:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959279872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.972723:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.972773:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48480 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.972789:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959279872 00000100:00100000:2.0:1788796526.972794:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959279872 00000100:00100000:2.0:1788796526.972824:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788796526.972832:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959279872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.975551:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959279872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2711us (2819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.975564:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788796526.975632:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959279872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.975682:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959280000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.975729:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.975782:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48480 going to sleep for 11 seconds 00000100:00100000:3.0:1788796526.976615:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796526.977106:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959280000 00000100:00100000:1.0:1788796526.977115:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959280000 00000100:00100000:1.0:1788796526.977149:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936183680 00000100:00100000:1.0:1788796526.977151:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936183680 00000100:00100000:1.0:1788796526.977165:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788796526.977173:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959280000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796526.977389:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959280000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.977879:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 164 00000100:00100000:1.0:1788796526.977978:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788796526.979424:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5599:x1875688936183680:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.979706:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5599:x1875688936183680:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 1817us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.979715:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 164 00000100:00100000:3.0:1788796526.984518:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959280000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796526.984530:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796526.984573:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936183808 00000100:00100000:1.0:1788796526.984580:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936183808 00000100:00100000:1.0:1788796526.984639:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 165 00000100:00100000:1.0:1788796526.984652:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5599:x1875688936183808:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796526.984885:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:5599:x1875688936183808:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 236us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796526.988154:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 165 00000100:00100000:2.0:1788796526.989678:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8525:1875688959280128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796526.989770:0:8525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.989806:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959280128 00000100:00100000:2.0:1788796526.989813:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959280128 00000100:00100000:2.0:1788796526.989859:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788796526.989867:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+14:8525:x1875688959280128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796526.991851:0:8525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24676ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788796526.993370:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+14:8525:x1875688959280128:12345-0@lo:502:llog_process_th.0 Request processed in 3495us (3592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.993383:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788796526.994439:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796526.994634:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8525:1875688959280128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788796526.994680:0:8525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788796526.994691:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796526.994693:0:8525:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788796526.994699:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788796526.994735:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261295180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8525:1875688959280256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796526.994804:0:8525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796526.994836:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936183936 00000100:00100000:1.0:1788796526.994842:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936183936 00000100:00100000:1.0:1788796526.994876:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959280256 00000100:00100000:1.0:1788796526.994878:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959280256 00000100:00100000:1.0:1788796526.997632:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00100000:1.0:1788796526.997656:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:6106:x1875688936183936:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788796526.997925:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:6106:x1875688936183936:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 277us (3491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.998208:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788796526.998230:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:8525:x1875688959280256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796526.998406:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:8525:x1875688959280256:12345-0@lo:502:llog_process_th.0 Request processed in 180us (3601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796526.998414:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788796526.998685:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00100000:1.0:1788796526.998872:0:8525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83180 going to sleep for 11 seconds 00000100:00100000:1.0:1788796526.998907:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261295180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8525:1875688959280256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788796526.998941:0:8525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788796526.998948:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796526.998950:0:8525:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788796526.998954:0:8525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788796526.999289:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788796526.999310:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788796526.999502:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22698 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.999515:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22698 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796526.999524:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788796526.999526:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd2467d7000 from 4 10000000:01000000:2.0:1788796526.999530:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788796526.999562:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2269f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.999571:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2269f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796526.999581:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2269f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796526.999609:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959280384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788796526.999654:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796526.999684:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24676e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788796527.000030:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959280384 00000100:00100000:1.0:1788796527.000038:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959280384 00000100:00100000:1.0:1788796527.000087:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788796527.000096:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:5841:x1875688959280384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796527.000107:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796527.000132:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe226a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2269f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796527.000154:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe226a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2269f expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796527.000164:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe226a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2269f expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796527.000172:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335a00, rc 0) 00000100:00100000:1.0:1788796527.000228:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959280384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796527.000235:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788796527.000509:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959280384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796527.000526:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2269f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226a6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796527.000535:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2269f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe226a6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796527.000584:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eadbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959280512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796527.000612:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796527.000649:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796527.002377:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959280512 00000100:00100000:2.0:1788796527.002388:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959280512 00000100:00100000:2.0:1788796527.002438:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788796527.002447:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959280512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796527.002740:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959280512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796527.002772:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788796527.002825:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eadbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959280512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796527.002871:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959280640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796527.002913:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796527.002941:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959280640 00000100:00100000:0.0:1788796527.002948:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959280640 00000100:00100000:2.0:1788796527.002950:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2504deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796527.002995:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788796527.003553:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959280640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796527.003788:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959280640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 778us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796527.003809:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788796527.006440:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959280640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796527.007527:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8526:1875688959280768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796527.007609:0:8526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796527.007658:0:8526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2504dee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788796527.007820:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959280768 00000100:00100000:1.0:1788796527.007828:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959280768 00000100:00100000:1.0:1788796527.007886:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788796527.007895:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+15:8526:x1875688959280768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796527.011437:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+15:8526:x1875688959280768:12345-0@lo:502:llog_process_th.0 Request processed in 3532us (3817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796527.011462:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788796527.013575:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8526:1875688959280768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796527.014437:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796527.014581:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936184064 00000100:00100000:3.0:1788796527.014591:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936184064 00000100:00100000:3.0:1788796527.014684:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 173 00000100:00100000:3.0:1788796527.014734:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:6106:x1875688936184064:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788796527.015001:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:6106:x1875688936184064:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 306us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796527.015009:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 173 00000020:01000000:2.0:1788796527.015882:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796527.015896:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796527.015899:0:8526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788796527.015906:0:8526:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd2467d7000 00000020:00000080:2.0:1788796527.015908:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788796527.016047:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c620a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8526:1875688959280896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796527.017232:0:8526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796527.017275:0:8526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2504dee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788796527.018219:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959280896 00000100:00100000:1.0:1788796527.018233:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959280896 00000100:00100000:1.0:1788796527.018288:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788796527.018298:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+15:8526:x1875688959280896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796527.018554:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+15:8526:x1875688959280896:12345-0@lo:502:llog_process_th.0 Request processed in 257us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796527.018563:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788796527.018820:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c620a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8526:1875688959280896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788796527.018853:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796527.018862:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796527.018864:0:8526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788796527.018868:0:8526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788796527.019910:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788796527.019936:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788796527.019947:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2269f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226a6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796527.019960:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2269f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226a6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796527.019970:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788796527.019973:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd250afa000 from 39 10000000:01000000:1.0:1788796527.019976:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788796527.020013:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796527.020021:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796527.020032:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796527.020170:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261295180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959281024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788796527.020317:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796527.021338:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796527.027528:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959281024 00000100:00100000:0.0:1788796527.027546:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959281024 00000100:00100000:1.0:1788796527.040178:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788796527.040197:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+15:5841:x1875688959281024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796527.040232:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796527.040252:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd267335600/0xdd273c88cfe226b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe226ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796527.040278:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd267335600/0xdd273c88cfe226b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe226ad expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796527.040290:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd267335600/0xdd273c88cfe226b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe226ad expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796527.040299:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335600, rc 0) 00000100:00100000:1.0:1788796527.040381:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959281024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (20063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796527.040388:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788796527.040570:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261295180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959281024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796527.040590:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796527.040601:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe226b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796527.040681:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eadbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959281152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796527.040715:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796527.044824:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14180 going to sleep for 11 seconds 00000100:00100000:0.0:1788796527.048506:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959281152 00000100:00100000:0.0:1788796527.048522:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959281152 00000100:00100000:0.0:1788796527.048580:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788796527.048590:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959281152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796527.050242:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959281152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1646us (9518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796527.050255:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788796527.052404:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eadbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959281152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796527.052528:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261295f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959281280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796527.052604:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796527.052650:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788796527.052702:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959281280 00000100:00100000:3.0:1788796527.052710:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959281280 00000100:00100000:3.0:1788796527.052784:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788796527.052795:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959281280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796527.053205:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959281280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 410us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796527.053286:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788796527.053371:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261295f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959281280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796527.053785:0:8529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261295f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8529:1875688959281408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796527.053834:0:8529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796527.053866:0:8529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796527.053930:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959281408 00000100:00100000:0.0:1788796527.053937:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959281408 00000100:00100000:0.0:1788796527.053976:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788796527.053984:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:8529:x1875688959281408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796527.054197:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:8529:x1875688959281408:12345-0@lo:502:llog_process_th.0 Request processed in 213us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796527.054205:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788796527.055040:0:8529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261295f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8529:1875688959281408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796527.055167:0:8529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8529:1875688959281536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796527.055287:0:8529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796527.055355:0:8529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14840 going to sleep for 11 seconds 00000100:00100000:1.0:1788796527.055500:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959281536 00000100:00100000:1.0:1788796527.055507:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959281536 00000100:00100000:1.0:1788796527.055581:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788796527.055589:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd249a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+16:8529:x1875688959281536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796527.056105:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd249a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+16:8529:x1875688959281536:12345-0@lo:502:llog_process_th.0 Request processed in 515us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796527.056113:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788796527.056348:0:8529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8529:1875688959281536:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788796527.056375:0:8529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788796527.056681:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788796527.056699:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788796527.056709:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796527.056720:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796527.056870:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788796527.056874:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788796527.056877:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788796527.056962:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796527.056971:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796527.056980:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796527.056999:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb19500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959281664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788796527.057037:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796527.057170:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27e459180 going to sleep for 11 seconds 00000100:00100000:1.0:1788796527.057208:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959281664 00000100:00100000:1.0:1788796527.057286:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959281664 00000100:00100000:1.0:1788796527.057360:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788796527.057369:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959281664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796527.057381:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796527.057393:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd267334800/0xdd273c88cfe226c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe226bb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796527.057492:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd267334800/0xdd273c88cfe226c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe226bb expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796527.057503:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd267334800/0xdd273c88cfe226c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe226bb expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796527.057512:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334800, rc 0) 00000100:00100000:1.0:1788796527.057561:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959281664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796527.057567:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788796527.057631:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb19500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959281664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796527.057644:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796527.057653:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe226c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796527.057701:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959281792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796527.057725:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796527.057876:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14840 going to sleep for 11 seconds 00000100:00100000:0.0:1788796527.058012:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959281792 00000100:00100000:0.0:1788796527.058017:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959281792 00000100:00100000:0.0:1788796527.058042:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788796527.058049:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959281792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796527.058545:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959281792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 495us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796527.058554:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788796527.058657:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959281792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796527.058693:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959281920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796527.058731:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796527.059661:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14840 going to sleep for 11 seconds 00000100:00100000:1.0:1788796527.059697:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959281920 00000100:00100000:1.0:1788796527.059712:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959281920 00000100:00100000:1.0:1788796527.059876:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788796527.059887:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959281920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796527.060422:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959281920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 536us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796527.060429:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788796527.061289:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959281920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796527.062019:0:8530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261297480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8530:1875688959282048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796527.062157:0:8530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796527.062302:0:8530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2467aa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796527.062351:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959282048 00000100:00100000:2.0:1788796527.062358:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959282048 00000100:00100000:2.0:1788796527.062500:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788796527.062510:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+17:8530:x1875688959282048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796527.065002:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+17:8530:x1875688959282048:12345-0@lo:502:llog_process_th.0 Request processed in 2482us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796527.065016:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788796527.065391:0:8530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261297480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8530:1875688959282048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788796527.065441:0:8530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796527.065451:0:8530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796527.065454:0:8530:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788796527.065472:0:8530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788796527.065513:0:8530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8530:1875688959282176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796527.065575:0:8530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796527.066388:0:8530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14840 going to sleep for 11 seconds 00000100:00100000:1.0:1788796527.066496:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959282176 00000100:00100000:1.0:1788796527.066504:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959282176 00000100:00100000:1.0:1788796527.066545:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788796527.066553:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+17:8530:x1875688959282176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796527.066884:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+17:8530:x1875688959282176:12345-0@lo:502:llog_process_th.0 Request processed in 331us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796527.066892:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788796527.067173:0:8530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8530:1875688959282176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788796527.067200:0:8530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796527.067206:0:8530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796527.067209:0:8530:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788796527.067367:0:8530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788796527.067606:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788796527.067624:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788796527.067636:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796527.067647:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796527.067664:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788796527.067666:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd250afa000 from 4 10000000:01000000:0.0:1788796527.067669:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788796527.067697:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe226c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796527.067705:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe226c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796527.067715:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe226c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796527.067734:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959282304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788796527.067805:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796527.067842:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27e459300 going to sleep for 11 seconds 00000100:00100000:1.0:1788796527.067964:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959282304 00000100:00100000:1.0:1788796527.067970:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959282304 00000100:00100000:1.0:1788796527.067996:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788796527.068003:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959282304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796527.068014:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796527.068025:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd267335c00/0xdd273c88cfe226d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe226c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796527.068045:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd267335c00/0xdd273c88cfe226d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe226c9 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796527.068143:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd267335c00/0xdd273c88cfe226d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe226c9 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796527.068152:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335c00, rc 0) 00000100:00100000:1.0:1788796527.068197:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959282304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796527.068203:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788796527.068318:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959282304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788796527.068579:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe226c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796527.068588:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe226c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe226d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796527.068636:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959282432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796527.068663:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796527.068678:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27e459300 going to sleep for 11 seconds 00000100:00100000:1.0:1788796527.068733:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959282432 00000100:00100000:1.0:1788796527.068738:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959282432 00000100:00100000:1.0:1788796527.068786:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788796527.068793:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959282432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796527.069164:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959282432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 370us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796527.069171:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788796527.069470:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959282432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796527.069509:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959282560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796527.069555:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796527.069618:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27e459300 going to sleep for 11 seconds 00000100:00100000:1.0:1788796527.069652:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959282560 00000100:00100000:1.0:1788796527.069657:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959282560 00000100:00100000:1.0:1788796527.069718:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788796527.069725:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959282560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796527.069975:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959282560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 249us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796527.069982:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788796527.070049:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959282560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796527.070567:0:8531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8531:1875688959282688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796527.070606:0:8531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796527.070871:0:8531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27e4599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796527.070990:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959282688 00000100:00100000:2.0:1788796527.070996:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959282688 00000100:00100000:2.0:1788796527.071023:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788796527.071030:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+18:8531:x1875688959282688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796527.071358:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+18:8531:x1875688959282688:12345-0@lo:502:llog_process_th.0 Request processed in 327us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796527.071365:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788796527.071511:0:8531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8531:1875688959282688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788796527.071538:0:8531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788796527.071547:0:8531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796527.071550:0:8531:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788796527.071557:0:8531:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd250afa000 00000020:00000080:0.0:1788796527.071560:0:8531:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788796527.071639:0:8531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8531:1875688959282816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796527.071676:0:8531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796527.071695:0:8531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27e4599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796527.071770:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959282816 00000100:00100000:2.0:1788796527.071774:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959282816 00000100:00100000:2.0:1788796527.071793:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788796527.071800:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+18:8531:x1875688959282816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796527.071929:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+18:8531:x1875688959282816:12345-0@lo:502:llog_process_th.0 Request processed in 128us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796527.071942:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788796527.072159:0:8531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:8531:1875688959282816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788796527.072178:0:8531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788796527.072183:0:8531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796527.072185:0:8531:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788796527.072189:0:8531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788796527.073931:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788796527.073960:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788796527.073970:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe226c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796527.073984:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe226c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796527.074007:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788796527.074009:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd26caa3370 from 1 10000000:01000000:0.0:1788796527.074012:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788796527.074046:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe226d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796527.074122:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe226d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796527.074134:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe226d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796527.074158:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959282944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788796527.074285:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796527.074330:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27e4599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796527.074384:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959282944 00000100:00100000:3.0:1788796527.074392:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959282944 00000100:00100000:3.0:1788796527.074506:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788796527.074515:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24a490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959282944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796527.074527:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796527.074539:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d20400/0xdd273c88cfe226de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe226d7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796527.074561:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d20400/0xdd273c88cfe226de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe226d7 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796527.074570:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d20400/0xdd273c88cfe226de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe226d7 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796527.074578:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20400, rc 0) 00000100:00100000:3.0:1788796527.074614:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24a490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959282944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796527.074620:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788796527.075493:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959282944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788796527.075513:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe226d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226de expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796527.075523:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe226d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe226de expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796527.075586:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959283072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796527.075624:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796527.075649:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27e4599c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796527.075711:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959283072 00000100:00100000:1.0:1788796527.075717:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959283072 00000100:00100000:1.0:1788796527.075782:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788796527.075790:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24a493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959283072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796527.076016:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24a493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959283072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (390us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788796527.076029:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788796527.080045:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959283072:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788796527.080107:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788796527.080118:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe226d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226de expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796527.080129:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe226d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226de expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796527.969775:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796528.476871:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959283200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788796528.476941:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796528.483699:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959283200 00000100:00100000:0.0:1788796528.483713:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959283200 00000100:00100000:0.0:1788796528.483804:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788796528.483817:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959283200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796528.483857:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796528.483938:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959283200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (6997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796528.483944:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788796528.483964:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788796528.484001:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd261294000 x1875688959283200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796528.486373:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959283200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788796528.986412:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796530.014045:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796531.039396:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796531.549932:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959283712:0@lo:400:kworker.0 00000100:00100000:1.0:1788796531.549996:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796531.550051:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788796531.550058:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959283328:0@lo:400:kworker.0 00000100:00100000:1.0:1788796531.550084:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796531.550108:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959283840:0@lo:400:kworker.0 00000100:00100000:1.0:1788796531.550131:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796531.550172:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959283456:0@lo:400:kworker.0 00000100:00100000:1.0:1788796531.550193:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796531.550222:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959283968:0@lo:400:kworker.0 00000100:00100000:1.0:1788796531.550242:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796531.550260:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788796531.550266:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959283584:0@lo:400:kworker.0 00000100:00100000:1.0:1788796531.550285:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796531.550315:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959283712 00000100:00100000:1.0:1788796531.550322:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959283712 00000100:00100000:1.0:1788796531.550382:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959283968 00000100:00100000:1.0:1788796531.550385:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959283968 00000100:00100000:1.0:1788796531.550402:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788796531.550410:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959283712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796531.550474:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959283712:12345-0@lo:400:kworker.0 Request processed in 64us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796531.550491:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788796531.550505:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788796531.550510:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959283968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796531.550538:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959283968:12345-0@lo:400:kworker.0 Request processed in 28us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796531.550543:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788796531.550557:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959283328 00000100:00100000:1.0:1788796531.550560:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959283328 00000100:00100000:1.0:1788796531.550580:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788796531.550586:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd272493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959283328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796531.550610:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd272493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959283328:12345-0@lo:400:kworker.0 Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796531.550615:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788796531.550655:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959283840 00000100:00100000:1.0:1788796531.550658:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959283840 00000100:00100000:1.0:1788796531.550674:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959283456 00000100:00100000:1.0:1788796531.550676:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959283456 00000100:00100000:1.0:1788796531.550685:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959283584 00000100:00100000:1.0:1788796531.550687:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959283584 00000100:00100000:1.0:1788796531.550698:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788796531.550703:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959283840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796531.550730:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959283840:12345-0@lo:400:kworker.0 Request processed in 27us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796531.550735:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788796531.550762:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788796531.550768:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959283456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796531.550799:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959283456:12345-0@lo:400:kworker.0 Request processed in 32us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796531.550805:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788796531.550815:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788796531.550821:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959283584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796531.550842:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959283584:12345-0@lo:400:kworker.0 Request processed in 22us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796531.550847:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788796531.550870:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788796531.550874:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788796531.550876:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788796531.550910:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959283584:0@lo:400:kworker.0 00000100:00100000:1.0:1788796531.550920:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959283456:0@lo:400:kworker.0 00010000:00080000:1.0:1788796531.550930:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd261297480 x1875688959283968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796531.550939:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959283968:0@lo:400:kworker.0 00000100:00100000:1.0:1788796531.550973:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959283328:0@lo:400:kworker.0 00000100:00100000:1.0:1788796531.550982:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959283840:0@lo:400:kworker.0 00010000:00080000:1.0:1788796531.550992:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd261296680 x1875688959283712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796531.551000:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959283712:0@lo:400:kworker.0 00000100:00100000:0.0:1788796531.595058:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796531.595098:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796531.595151:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936184192 00000100:00100000:0.0:1788796531.595163:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936184192 00000100:00100000:0.0:1788796531.595225:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 193 00000100:00100000:2.0:1788796531.595358:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936184448 00000100:00100000:2.0:1788796531.595363:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936184448 00000100:00100000:2.0:1788796531.595404:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:2.0:1788796531.595413:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2356:x1875688936184448:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796531.595492:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2356:x1875688936184448:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 81us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796531.595499:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00080000:2.0:1788796531.595520:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796531.595774:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd272492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936184192:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796531.595814:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd272492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936184192:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 580us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796531.595872:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 193 00000100:00100000:0.0:1788796531.596448:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796531.596489:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796531.596542:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936184320 00000100:00100000:2.0:1788796531.596550:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936184320 00000100:00100000:2.0:1788796531.596602:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:2.0:1788796531.596610:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2355:x1875688936184320:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796531.596648:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2355:x1875688936184320:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 38us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796531.596655:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00080000:2.0:1788796531.596670:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796531.599101:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936184576 00000100:00100000:1.0:1788796531.599118:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936184576 00000100:00100000:1.0:1788796531.599211:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:1.0:1788796531.599221:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+5:2355:x1875688936184576:12345-192.168.201.25@tcp:400:kworker.0 00000100:00080000:2.0:1788796531.599345:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788796531.599657:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+5:2355:x1875688936184576:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 437us (3167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796531.599666:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00010000:00010000:0.0:1788796532.060214:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796532.062343:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788796532.062367:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959284096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796532.062455:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796532.062579:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959284096 00000100:00100000:1.0:1788796532.062590:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959284096 00000100:00100000:1.0:1788796532.062652:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788796532.062663:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959284096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796532.062704:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796532.062776:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959284096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796532.062783:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788796532.062899:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd261296680 x1875688959284096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796532.062918:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959284096:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788796533.085608:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788796533.171819:0:8814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1788796533.594194:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959284224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796533.594287:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796533.594830:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959284224 00000100:00100000:1.0:1788796533.594840:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959284224 00000100:00100000:1.0:1788796533.594901:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788796533.594911:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959284224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796533.595051:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796533.595164:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959284224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 255us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796533.595171:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788796533.595444:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788796533.596549:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd261294000 x1875688959284224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796533.596579:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959284224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788796534.109443:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796535.130408:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796536.157950:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796536.669414:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959284352:0@lo:400:kworker.0 00000100:00100000:2.0:1788796536.669498:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796536.669600:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959284352 00000100:00100000:3.0:1788796536.669610:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959284352 00000100:00100000:3.0:1788796536.669658:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788796536.669666:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd272491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959284352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796536.673223:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd272491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959284352:12345-0@lo:400:kworker.0 Request processed in 3546us (3713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796536.673239:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788796536.673532:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959284352:0@lo:400:kworker.0 00000100:00100000:2.0:1788796536.673559:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788796536.673571:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959284736:0@lo:400:kworker.0 00000100:00100000:2.0:1788796536.673622:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796536.673664:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959284736 00000100:00100000:2.0:1788796536.673670:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959284736 00000100:00100000:2.0:1788796536.673738:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788796536.673765:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959284736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796536.673827:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959284736:12345-0@lo:400:kworker.0 Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796536.673834:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788796536.673850:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788796536.673873:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27eb18700 x1875688959284736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796536.673896:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959284736:0@lo:400:kworker.0 00000100:00100000:0.0:1788796536.674176:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788796536.674188:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959284864:0@lo:400:kworker.0 00000100:00100000:0.0:1788796536.674224:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796536.674455:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959284480:0@lo:400:kworker.0 00000100:00100000:0.0:1788796536.674480:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796536.674569:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959284992:0@lo:400:kworker.0 00000100:00100000:0.0:1788796536.674594:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796536.674622:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796536.674629:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959284608:0@lo:400:kworker.0 00000100:00100000:0.0:1788796536.674650:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796536.674683:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959284992 00000100:00100000:2.0:1788796536.674689:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959284992 00000100:00100000:2.0:1788796536.674725:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788796536.674732:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959284992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796536.674791:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959284992:12345-0@lo:400:kworker.0 Request processed in 59us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796536.674808:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788796536.674840:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788796536.682209:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27eb19180 x1875688959284992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796536.682230:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959284992:0@lo:400:kworker.0 00000100:00100000:3.0:1788796536.685372:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959284864 00000100:00100000:3.0:1788796536.685389:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959284864 00000100:00100000:3.0:1788796536.685464:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959284480 00000100:00100000:3.0:1788796536.685467:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959284480 00000100:00100000:3.0:1788796536.685480:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959284608 00000100:00100000:3.0:1788796536.685483:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959284608 00000100:00100000:3.0:1788796536.685500:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788796536.685509:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959284864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796536.685599:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959284864:12345-0@lo:400:kworker.0 Request processed in 90us (11373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796536.685606:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788796536.685633:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788796536.685639:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959284480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796536.685676:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959284480:12345-0@lo:400:kworker.0 Request processed in 37us (11195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796536.685681:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788796536.685691:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788796536.685697:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959284608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796536.685722:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959284608:12345-0@lo:400:kworker.0 Request processed in 25us (11071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796536.685727:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788796536.685797:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959284864:0@lo:400:kworker.0 00000100:00080000:3.0:1788796536.685956:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796536.685983:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959284608:0@lo:400:kworker.0 00000100:00100000:3.0:1788796536.685995:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959284480:0@lo:400:kworker.0 00000100:00100000:0.0:1788796536.715150:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796536.715193:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796536.715228:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796536.715330:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936184832 00000100:00100000:3.0:1788796536.715341:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936184832 00000100:00100000:3.0:1788796536.715412:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:3.0:1788796536.715423:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2357:x1875688936184832:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796536.715498:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2357:x1875688936184832:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 77us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796536.715505:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00080000:3.0:1788796536.716020:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796536.716121:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796536.716154:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936184704 00000100:00100000:0.0:1788796536.716160:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936184704 00000100:00100000:0.0:1788796536.716191:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 195 00000100:00100000:0.0:1788796536.716199:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2357:x1875688936184704:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796536.716238:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2357:x1875688936184704:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 40us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796536.716309:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 195 00000100:00100000:2.0:1788796536.716560:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936185088 00000100:00100000:2.0:1788796536.716565:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936185088 00000100:00100000:2.0:1788796536.716609:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936184960 00000100:00100000:2.0:1788796536.716612:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936184960 00000100:00100000:2.0:1788796536.716629:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:2.0:1788796536.716637:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+5:2357:x1875688936185088:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796536.716672:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+5:2357:x1875688936185088:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 35us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796536.716678:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:2.0:1788796536.716693:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:2.0:1788796536.716699:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+5:2357:x1875688936184960:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796536.716724:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+5:2357:x1875688936184960:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 25us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796536.716730:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00080000:0.0:1788796536.718012:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788796536.718026:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788796537.177882:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796537.178123:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959285120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796537.178195:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796537.178422:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959285120 00000100:00100000:1.0:1788796537.178431:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959285120 00000100:00100000:1.0:1788796537.178489:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788796537.178499:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959285120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796537.178537:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796537.178595:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959285120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796537.178602:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788796537.178690:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd261295880 x1875688959285120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796537.178709:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959285120:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788796538.201868:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796538.714833:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788796538.714856:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959285248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788796538.714922:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796538.719542:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959285248 00000100:00100000:3.0:1788796538.719556:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959285248 00000100:00100000:3.0:1788796538.719727:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788796538.719760:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959285248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788796538.719796:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796538.719872:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959285248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (4949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796538.719879:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788796538.720055:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788796538.720092:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd261297480 x1875688959285248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796538.720117:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959285248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788796539.233093:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788796539.462113:0:9058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing yml_node 00010000:00010000:0.0:1788796540.250652:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796541.274440:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796541.788401:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959285504:0@lo:400:kworker.0 00000100:00100000:3.0:1788796541.788471:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796541.788519:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959285376:0@lo:400:kworker.0 00000100:00100000:3.0:1788796541.788547:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959286016:0@lo:400:kworker.0 00000100:00100000:1.0:1788796541.788577:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796541.788584:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796541.788617:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959285888:0@lo:400:kworker.0 00000100:00100000:3.0:1788796541.788629:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788796541.788639:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959285632:0@lo:400:kworker.0 00000100:00100000:1.0:1788796541.788646:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796541.788671:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796541.788674:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788796541.788683:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959285760:0@lo:400:kworker.0 00000100:00100000:3.0:1788796541.788711:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959286016 00000100:00100000:1.0:1788796541.788712:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796541.788720:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959286016 00000100:00100000:1.0:1788796541.788792:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959285376 00000100:00100000:1.0:1788796541.788797:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959285376 00000100:00100000:3.0:1788796541.788806:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959285760 00000100:00100000:3.0:1788796541.788811:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959285760 00000100:00100000:1.0:1788796541.788833:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788796541.788838:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788796541.788847:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959285376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796541.788849:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959286016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796541.788912:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959285376:12345-0@lo:400:kworker.0 Request processed in 70us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796541.788916:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959286016:12345-0@lo:400:kworker.0 Request processed in 69us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796541.788925:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788796541.788930:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788796541.788949:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788796541.788969:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959285760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796541.788977:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959285504 00000100:00100000:1.0:1788796541.788982:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959285504 00000100:00100000:1.0:1788796541.789014:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959285888 00000100:00100000:1.0:1788796541.789018:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959285888 00000100:00100000:3.0:1788796541.789036:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959285760:12345-0@lo:400:kworker.0 Request processed in 79us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796541.789037:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959285632 00000100:00100000:1.0:1788796541.789042:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959285632 00000100:00100000:3.0:1788796541.789047:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788796541.789064:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788796541.789072:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959285504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796541.789106:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959285504:12345-0@lo:400:kworker.0 Request processed in 34us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796541.789112:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788796541.789124:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788796541.789130:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959285888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796541.789156:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959285888:12345-0@lo:400:kworker.0 Request processed in 27us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796541.789162:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788796541.789174:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788796541.789180:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959285632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796541.789205:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959285632:12345-0@lo:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796541.789211:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788796541.789511:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788796541.789517:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788796541.789519:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788796541.789679:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd2671ba300 x1875688959285760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796541.789694:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959285760:0@lo:400:kworker.0 00000100:00100000:0.0:1788796541.789704:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959285376:0@lo:400:kworker.0 00000100:00100000:0.0:1788796541.789715:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959285888:0@lo:400:kworker.0 00000100:00100000:0.0:1788796541.789790:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959285632:0@lo:400:kworker.0 00000100:00100000:0.0:1788796541.789800:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959285504:0@lo:400:kworker.0 00010000:00080000:0.0:1788796541.789809:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27b4f8380 x1875688959286016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796541.789819:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959286016:0@lo:400:kworker.0 00000100:00100000:3.0:1788796541.847725:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796541.847902:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796541.847925:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796541.847998:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936185344 00000100:00100000:1.0:1788796541.848011:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936185344 00000100:00100000:3.0:1788796541.848028:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796541.848093:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:1.0:1788796541.848104:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936185344:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796541.848125:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936185216 00000100:00100000:0.0:1788796541.848131:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936185216 00000100:00100000:0.0:1788796541.848182:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 197 00000100:00100000:1.0:1788796541.848188:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936185344:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 84us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796541.848194:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936185216:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796541.848202:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:0.0:1788796541.848230:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936185216:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 40us (327us total) trans 0 rc 0/0 00000100:00080000:1.0:1788796541.848340:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796541.848507:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 197 00000100:00100000:2.0:1788796541.853331:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936185472 00000100:00100000:2.0:1788796541.853348:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936185472 00000100:00100000:2.0:1788796541.853432:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936185600 00000100:00100000:2.0:1788796541.853436:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936185600 00000100:00100000:2.0:1788796541.853460:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:2.0:1788796541.853470:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+5:2354:x1875688936185472:12345-192.168.201.25@tcp:9:kworker.0 00000020:00000080:2.0:1788796541.853510:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe2261a 00000100:00080000:2.0:1788796541.853521:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9bd27ead5000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788796541.853562:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1788796541.854029:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788796541.854035:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788796541.854061:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796541.855884:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+2:2354:x1875688936185472:12345-192.168.201.25@tcp:9:kworker.0 Request processed in 2406us (8159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796541.855910:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:2.0:1788796541.855941:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:2.0:1788796541.856050:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+5:2354:x1875688936185600:12345-192.168.201.25@tcp:9:kworker.0 00000020:00000080:2.0:1788796541.856080:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22621 00000100:00080000:2.0:1788796541.856089:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9bd27ead2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788796541.856139:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788796541.856561:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+2:2354:x1875688936185600:12345-192.168.201.25@tcp:9:kworker.0 Request processed in 611us (8533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796541.856569:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00010000:00010000:3.0:1788796541.857551:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796542.298013:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796542.298122:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959286144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796542.298204:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796542.298517:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959286144 00000100:00100000:1.0:1788796542.298526:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959286144 00000100:00100000:1.0:1788796542.298590:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788796542.298599:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959286144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796542.298632:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796542.298688:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959286144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796542.298696:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788796542.298727:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd261294700 x1875688959286144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796542.298773:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959286144:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788796543.322989:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796543.835000:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788796543.835024:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959286272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788796543.835105:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796543.835310:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959286272 00000100:00100000:2.0:1788796543.835319:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959286272 00000100:00100000:2.0:1788796543.835435:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788796543.835446:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959286272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788796543.835479:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796543.835533:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959286272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796543.835550:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788796543.835600:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788796543.841140:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27b4f9c00 x1875688959286272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796543.841177:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959286272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788796544.346089:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788796544.577776:0:9250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:0.0:1788796545.370067:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788796545.439452:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad2796a3-2145-47da-88fb-baa43721bec1 00000020:00000080:3.0:1788796545.439460:0:6716:0:(genops.c:885:class_export_put()) final put ffff9bd27ead3000/ad2796a3-2145-47da-88fb-baa43721bec1 00000020:00000080:3.0:1788796545.439485:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27ead3000/ad2796a3-2145-47da-88fb-baa43721bec1 for lustre-OST0000 00000020:00000080:3.0:1788796545.439518:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd27ead5000 for lustre-OST0000 00000001:00100000:3.0:1788796545.485147:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ad2796a3-2145-47da-88fb-baa43721bec1 00000020:00000080:3.0:1788796545.485157:0:7649:0:(genops.c:885:class_export_put()) final put ffff9bd27ead2000/ad2796a3-2145-47da-88fb-baa43721bec1 00000020:00000080:3.0:1788796545.485187:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27ead2000/ad2796a3-2145-47da-88fb-baa43721bec1 for lustre-OST0001 00000020:00000080:3.0:1788796545.485235:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd27ead2800 for lustre-OST0001 00010000:00010000:2.0:1788796546.394942:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796546.908099:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959286656:0@lo:400:kworker.0 00000100:00100000:0.0:1788796546.908168:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796546.908228:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788796546.908235:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959286528:0@lo:400:kworker.0 00000100:00100000:0.0:1788796546.908256:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796546.908271:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959287040:0@lo:400:kworker.0 00000100:00100000:0.0:1788796546.908313:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796546.908773:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959286400:0@lo:400:kworker.0 00000100:00100000:2.0:1788796546.908810:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796546.908842:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959286912:0@lo:400:kworker.0 00000100:00100000:2.0:1788796546.908876:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796546.908896:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788796546.908901:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959286784:0@lo:400:kworker.0 00000100:00100000:2.0:1788796546.908922:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796546.908996:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959286656 00000100:00100000:1.0:1788796546.909004:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959286656 00000100:00100000:1.0:1788796546.909060:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959286528 00000100:00100000:1.0:1788796546.909074:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959286528 00000100:00100000:1.0:1788796546.909090:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959286912 00000100:00100000:1.0:1788796546.909092:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959286912 00000100:00100000:1.0:1788796546.909107:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788796546.909116:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959286656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796546.909177:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959286656:12345-0@lo:400:kworker.0 Request processed in 61us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796546.909184:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788796546.909202:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788796546.909208:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959286528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796546.909231:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959286528:12345-0@lo:400:kworker.0 Request processed in 24us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796546.909243:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788796546.909255:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788796546.909260:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959286912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796546.909293:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959286912:12345-0@lo:400:kworker.0 Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796546.909299:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788796546.909338:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959286912:0@lo:400:kworker.0 00000100:00080000:2.0:1788796546.909783:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796546.909875:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959287040 00000100:00100000:3.0:1788796546.909880:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959287040 00000100:00100000:3.0:1788796546.909927:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959286784 00000100:00100000:3.0:1788796546.909931:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959286784 00000100:00100000:3.0:1788796546.909949:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788796546.909957:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959287040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796546.910008:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959287040:12345-0@lo:400:kworker.0 Request processed in 53us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796546.910015:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788796546.910030:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788796546.910036:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959286784:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788796546.910178:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788796546.910182:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788796546.910233:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959286784:12345-0@lo:400:kworker.0 Request processed in 197us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796546.910241:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788796546.910333:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27eb18380 x1875688959286784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796546.910346:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959286784:0@lo:400:kworker.0 00000100:00100000:0.0:1788796546.910618:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959286400 00000100:00100000:0.0:1788796546.910625:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959286400 00000100:00100000:0.0:1788796546.910670:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788796546.910679:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959286400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796546.910722:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959286400:12345-0@lo:400:kworker.0 Request processed in 46us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796546.910728:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788796546.910795:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959286400:0@lo:400:kworker.0 00000100:00100000:0.0:1788796546.911642:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959286528:0@lo:400:kworker.0 00010000:00080000:0.0:1788796546.911673:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd26c623100 x1875688959287040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796546.911683:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959287040:0@lo:400:kworker.0 00000100:00100000:0.0:1788796546.911695:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959286656:0@lo:400:kworker.0 00000100:00100000:3.0:1788796546.951081:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796546.951117:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796546.951144:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936185728 00000100:00100000:3.0:1788796546.951154:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936185728 00000100:00100000:3.0:1788796546.951198:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 199 00000100:00100000:3.0:1788796546.951209:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936185728:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796546.951284:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936185728:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796546.951291:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 199 00000100:00100000:3.0:1788796546.951322:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936185856 00000100:00100000:3.0:1788796546.951326:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936185856 00000100:00100000:3.0:1788796546.952222:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:3.0:1788796546.952233:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936185856:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796546.952278:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936185856:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 47us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796546.952285:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00080000:0.0:1788796546.952482:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788796547.300362:0:9350:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:0.0:1788796547.419140:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796547.419180:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788796547.419206:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959287168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796547.419275:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796547.419506:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959287168 00000100:00100000:0.0:1788796547.419515:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959287168 00000100:00100000:0.0:1788796547.419574:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788796547.419586:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959287168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788796547.419621:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796547.419676:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959287168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796547.419684:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788796547.419722:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27d7ad500 x1875688959287168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796547.419740:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959287168:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788796548.444170:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796548.955770:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788796548.955796:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959287296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796548.955880:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796548.956217:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959287296 00000100:00100000:1.0:1788796548.956225:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959287296 00000100:00100000:1.0:1788796548.956286:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788796548.956296:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959287296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796548.956328:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796548.956374:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959287296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796548.956381:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788796548.956634:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788796548.956665:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27b4faa00 x1875688959287296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796548.956696:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959287296:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788796549.465950:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788796550.311579:0:9448:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:3.0:1788796550.497390:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796551.513897:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796552.034896:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959287808:0@lo:400:kworker.0 00000100:00100000:1.0:1788796552.035028:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796552.035097:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788796552.035103:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959287424:0@lo:400:kworker.0 00000100:00100000:1.0:1788796552.035133:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796552.035157:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26c622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959287936:0@lo:400:kworker.0 00000100:00100000:1.0:1788796552.035177:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796552.035204:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959287552:0@lo:400:kworker.0 00000100:00100000:1.0:1788796552.035242:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796552.035263:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25030ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959288064:0@lo:400:kworker.0 00000100:00100000:1.0:1788796552.035282:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796552.035300:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788796552.035306:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959287680:0@lo:400:kworker.0 00000100:00100000:1.0:1788796552.035323:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796552.035356:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959287808 00000100:00100000:1.0:1788796552.035363:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959287808 00000100:00100000:1.0:1788796552.035599:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959288064 00000100:00100000:1.0:1788796552.035603:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959288064 00000100:00100000:1.0:1788796552.035624:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788796552.035633:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959287808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796552.035687:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959287808:12345-0@lo:400:kworker.0 Request processed in 55us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796552.035694:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788796552.035718:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788796552.035724:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959288064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796552.035790:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959288064:12345-0@lo:400:kworker.0 Request processed in 65us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796552.035796:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788796552.035813:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959287424 00000100:00100000:1.0:1788796552.035816:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959287424 00000100:00100000:1.0:1788796552.035840:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788796552.035846:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959287424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796552.035875:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959287424:12345-0@lo:400:kworker.0 Request processed in 29us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796552.035890:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788796552.035919:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959287936 00000100:00100000:1.0:1788796552.035923:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959287936 00000100:00100000:1.0:1788796552.035941:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959287552 00000100:00100000:1.0:1788796552.035944:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959287552 00000100:00100000:1.0:1788796552.035954:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959287680 00000100:00100000:1.0:1788796552.035956:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959287680 00000100:00100000:1.0:1788796552.038098:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788796552.038120:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959287936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796552.038192:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959287936:12345-0@lo:400:kworker.0 Request processed in 79us (3012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796552.038197:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788796552.038222:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788796552.038227:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959287552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796552.038255:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959287552:12345-0@lo:400:kworker.0 Request processed in 28us (3012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796552.038261:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788796552.038275:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788796552.038282:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959287680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796552.038309:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959287680:12345-0@lo:400:kworker.0 Request processed in 28us (2985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796552.038314:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788796552.038350:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788796552.038355:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788796552.038359:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788796552.040157:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959287680:0@lo:400:kworker.0 00000100:00100000:1.0:1788796552.040194:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959287552:0@lo:400:kworker.0 00010000:00080000:1.0:1788796552.040210:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd25030ea00 x1875688959288064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796552.040221:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25030ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959288064:0@lo:400:kworker.0 00000100:00100000:1.0:1788796552.040273:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959287424:0@lo:400:kworker.0 00000100:00100000:1.0:1788796552.040285:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959287936:0@lo:400:kworker.0 00010000:00080000:1.0:1788796552.040297:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd26c623100 x1875688959287808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796552.040306:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26c623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959287808:0@lo:400:kworker.0 00000001:02000400:2.0:1788796552.063946:0:9496:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 11:55:51 EDT 2026 00000100:00100000:3.0:1788796552.069547:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796552.069596:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796552.069790:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936185984 00000100:00100000:0.0:1788796552.069800:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936185984 00000100:00100000:0.0:1788796552.069850:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 201 00000100:00100000:0.0:1788796552.069859:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936185984:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796552.069919:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936185984:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 61us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796552.069927:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 201 00000100:00100000:1.0:1788796552.070096:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936186112 00000100:00100000:1.0:1788796552.070100:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936186112 00000100:00100000:1.0:1788796552.070149:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:1.0:1788796552.070156:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936186112:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796552.070193:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936186112:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 38us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796552.070199:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00080000:0.0:1788796552.070332:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796552.538757:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788796552.539707:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796552.544148:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959288192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796552.544231:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796552.544419:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959288192 00000100:00100000:1.0:1788796552.544429:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959288192 00000100:00100000:1.0:1788796552.544478:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788796552.544487:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959288192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796552.544525:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796552.544583:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959288192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796552.544606:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788796552.544978:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27d7ac700 x1875688959288192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796552.544998:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959288192:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788796553.562156:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796554.075120:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788796554.075143:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959288320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796554.075211:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796554.075302:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959288320 00000100:00100000:2.0:1788796554.075310:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959288320 00000100:00100000:2.0:1788796554.075382:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788796554.075391:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959288320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788796554.075424:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796554.075471:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959288320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796554.075478:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788796554.075780:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788796554.075811:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27b4f9c00 x1875688959288320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796554.075831:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959288320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788796554.586678:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796555.610226:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796556.633840:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796557.148250:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959288576:0@lo:400:kworker.0 00000100:00100000:0.0:1788796557.148319:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796557.148376:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959289088:0@lo:400:kworker.0 00000100:00100000:0.0:1788796557.148402:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796557.148445:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796557.148452:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959288704:0@lo:400:kworker.0 00000100:00100000:0.0:1788796557.148476:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796557.148512:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959288576 00000100:00100000:0.0:1788796557.148542:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959288576 00000100:00100000:0.0:1788796557.148587:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959288704 00000100:00100000:0.0:1788796557.148590:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959288704 00000100:00100000:0.0:1788796557.148614:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788796557.148622:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959288576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796557.148697:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959288576:12345-0@lo:400:kworker.0 Request processed in 65us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796557.148704:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788796557.148723:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788796557.148730:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959288704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796557.148783:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959288704:12345-0@lo:400:kworker.0 Request processed in 54us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796557.148789:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788796557.148808:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959289088 00000100:00100000:0.0:1788796557.148811:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959289088 00000100:00100000:0.0:1788796557.148840:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788796557.148846:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959289088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796557.148876:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959289088:12345-0@lo:400:kworker.0 Request processed in 31us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796557.148895:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788796557.148919:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788796557.148924:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796557.148956:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959288704:0@lo:400:kworker.0 00000100:00100000:0.0:1788796557.148966:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959288576:0@lo:400:kworker.0 00010000:00080000:0.0:1788796557.148978:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27d7ad180 x1875688959289088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796557.149001:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959289088:0@lo:400:kworker.0 00000100:00100000:2.0:1788796557.149328:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959288832:0@lo:400:kworker.0 00000100:00100000:2.0:1788796557.149366:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796557.149393:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788796557.149399:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959288448:0@lo:400:kworker.0 00000100:00100000:2.0:1788796557.149436:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796557.149461:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959288960:0@lo:400:kworker.0 00000100:00100000:2.0:1788796557.149482:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796557.149509:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959288832 00000100:00100000:2.0:1788796557.149514:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959288832 00000100:00100000:2.0:1788796557.149659:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788796557.149667:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959288832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796557.149717:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959288832:12345-0@lo:400:kworker.0 Request processed in 51us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796557.149723:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788796557.149742:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959288448 00000100:00100000:2.0:1788796557.149768:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959288448 00000100:00100000:2.0:1788796557.149793:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788796557.149799:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959288448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796557.149828:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959288448:12345-0@lo:400:kworker.0 Request processed in 30us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796557.149833:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:2.0:1788796557.149858:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788796557.149876:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959288448:0@lo:400:kworker.0 00010000:00080000:2.0:1788796557.149998:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27d7af100 x1875688959288832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796557.150007:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959288832:0@lo:400:kworker.0 00000100:00100000:2.0:1788796557.150040:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959288960 00000100:00100000:2.0:1788796557.150044:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959288960 00000100:00100000:2.0:1788796557.150073:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788796557.150079:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959288960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796557.150113:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959288960:12345-0@lo:400:kworker.0 Request processed in 34us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796557.150119:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788796557.150134:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796557.150149:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959288960:0@lo:400:kworker.0 00000100:00100000:1.0:1788796557.200432:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796557.200481:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796557.203004:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936186240 00000100:00100000:0.0:1788796557.203017:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936186240 00000100:00100000:0.0:1788796557.203078:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 203 00000100:00100000:0.0:1788796557.203089:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936186240:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796557.203167:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936186240:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 79us (2757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796557.203174:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 203 00000100:00100000:0.0:1788796557.203210:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936186368 00000100:00100000:0.0:1788796557.203214:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936186368 00000100:00100000:0.0:1788796557.203251:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:0.0:1788796557.203259:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936186368:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796557.203287:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936186368:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 30us (2807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796557.203293:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00080000:0.0:1788796557.203896:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796557.658841:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959289216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796557.658912:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796557.658958:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959289216 00000100:00100000:1.0:1788796557.658969:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959289216 00010000:00010000:0.0:1788796557.659026:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796557.659028:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788796557.659040:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959289216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796557.659078:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796557.659145:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959289216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796557.659153:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788796557.659173:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27d7ad180 x1875688959289216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796557.659194:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959289216:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788796558.685709:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796559.193905:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788796559.193929:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959289344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796559.194002:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796559.194100:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959289344 00000100:00100000:0.0:1788796559.194107:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959289344 00000100:00100000:0.0:1788796559.194163:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788796559.194177:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959289344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796559.194212:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796559.194257:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959289344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796559.194264:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788796559.194285:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788796559.194317:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27d7ad180 x1875688959289344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796559.194337:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959289344:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788796559.706301:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796560.730616:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796561.755474:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796562.267060:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959289728:0@lo:400:kworker.0 00000100:00100000:0.0:1788796562.267136:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796562.267186:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788796562.267191:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959289600:0@lo:400:kworker.0 00000100:00100000:0.0:1788796562.267206:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796562.267217:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959290112:0@lo:400:kworker.0 00000100:00100000:0.0:1788796562.267231:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796562.267255:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959289728 00000100:00100000:0.0:1788796562.267261:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959289728 00000100:00100000:0.0:1788796562.267296:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959289600 00000100:00100000:0.0:1788796562.267298:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959289600 00000100:00100000:0.0:1788796562.267324:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788796562.267330:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959289728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796562.267374:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959289728:12345-0@lo:400:kworker.0 Request processed in 45us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796562.267379:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788796562.267392:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788796562.267396:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959289600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796562.267410:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959289600:12345-0@lo:400:kworker.0 Request processed in 15us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796562.267414:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788796562.267425:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959290112 00000100:00100000:0.0:1788796562.267427:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959290112 00000100:00100000:0.0:1788796562.267453:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788796562.267458:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959290112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796562.267475:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959290112:12345-0@lo:400:kworker.0 Request processed in 18us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796562.267479:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788796562.267489:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788796562.267493:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796562.267514:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959289600:0@lo:400:kworker.0 00010000:00080000:0.0:1788796562.267522:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27d7ae680 x1875688959290112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796562.267531:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959290112:0@lo:400:kworker.0 00000100:00100000:0.0:1788796562.267540:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959289728:0@lo:400:kworker.0 00000100:00100000:3.0:1788796562.267637:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959289856:0@lo:400:kworker.0 00000100:00100000:3.0:1788796562.267667:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796562.267694:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788796562.267699:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959289472:0@lo:400:kworker.0 00000100:00100000:3.0:1788796562.267722:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796562.267740:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959289984:0@lo:400:kworker.0 00000100:00100000:3.0:1788796562.267804:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796562.267828:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959289984 00000100:00100000:3.0:1788796562.267831:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959289984 00000100:00100000:3.0:1788796562.267860:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788796562.267866:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959289984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796562.267900:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959289984:12345-0@lo:400:kworker.0 Request processed in 34us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796562.267906:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788796562.267922:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796562.267937:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959289984:0@lo:400:kworker.0 00000100:00100000:2.0:1788796562.268094:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959289856 00000100:00100000:2.0:1788796562.268099:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959289856 00000100:00100000:2.0:1788796562.268141:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788796562.268148:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959289856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796562.268191:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959289856:12345-0@lo:400:kworker.0 Request processed in 43us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796562.268196:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788796562.268212:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959289472 00000100:00100000:2.0:1788796562.268216:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959289472 00000100:00100000:2.0:1788796562.268238:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788796562.268244:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959289472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796562.268273:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959289472:12345-0@lo:400:kworker.0 Request processed in 29us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796562.268279:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788796562.268315:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959289472:0@lo:400:kworker.0 00010000:00080000:2.0:1788796562.268336:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27d7aea00 x1875688959289856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796562.268346:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959289856:0@lo:400:kworker.0 00000100:00080000:3.0:1788796562.268489:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788796562.309625:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796562.309681:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796562.309878:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936186624 00000100:00100000:3.0:1788796562.309888:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936186624 00000100:00100000:3.0:1788796562.311564:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:3.0:1788796562.311581:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2355:x1875688936186624:12345-192.168.201.25@tcp:400:kworker.0 00000100:00080000:1.0:1788796562.311668:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796562.311676:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2355:x1875688936186624:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 101us (2090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796562.311684:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:0.0:1788796562.317191:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936186496 00000100:00100000:0.0:1788796562.317221:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936186496 00000100:00100000:0.0:1788796562.317445:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 205 00000100:00100000:0.0:1788796562.317459:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2355:x1875688936186496:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796562.317550:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2355:x1875688936186496:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 94us (7868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796562.317557:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 205 00000100:00100000:2.0:1788796562.779019:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959290240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796562.779100:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796562.779544:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959290240 00000100:00100000:1.0:1788796562.779554:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959290240 00000100:00100000:1.0:1788796562.779630:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788796562.779640:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959290240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796562.779680:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796562.794820:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959290240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 15172us (15709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796562.794836:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788796562.796198:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788796562.812325:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27d7ad880 x1875688959290240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796578 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796562.812352:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959290240:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788796563.802171:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796564.314175:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959290368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796564.314249:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796564.314511:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959290368 00000100:00100000:0.0:1788796564.314520:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959290368 00000100:00100000:0.0:1788796564.314640:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788796564.314653:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959290368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796564.314688:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796564.314785:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959290368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796564.314795:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788796564.314796:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27d7ae680 x1875688959290368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796564.314820:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959290368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788796564.314848:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788796564.825941:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796565.849912:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788796566.818737:0:10127:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 11:56:05 (1788796565) === 00010000:00010000:3.0:1788796566.880550:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796567.386174:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959290880:0@lo:400:kworker.0 00000100:00100000:3.0:1788796567.386268:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796567.386352:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788796567.386373:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959290496:0@lo:400:kworker.0 00000100:00100000:3.0:1788796567.386410:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796567.386445:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959291008:0@lo:400:kworker.0 00000100:00100000:3.0:1788796567.386518:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796567.386561:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959290496 00000100:00100000:3.0:1788796567.386568:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959290496 00000100:00100000:3.0:1788796567.386632:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788796567.386642:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959290496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796567.386700:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959290496:12345-0@lo:400:kworker.0 Request processed in 59us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796567.386726:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788796567.386780:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959291008 00000100:00100000:3.0:1788796567.386784:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959291008 00000100:00100000:3.0:1788796567.386827:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788796567.386835:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959291008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796567.386869:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959291008:12345-0@lo:400:kworker.0 Request processed in 36us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796567.386884:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788796567.386908:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796567.386952:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959290496:0@lo:400:kworker.0 00000100:00100000:3.0:1788796567.386965:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959291008:0@lo:400:kworker.0 00000100:00100000:0.0:1788796567.387137:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959290880 00000100:00100000:0.0:1788796567.387142:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959290880 00000100:00100000:0.0:1788796567.387178:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788796567.387192:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959290880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796567.387236:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959290880:12345-0@lo:400:kworker.0 Request processed in 48us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796567.387242:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788796567.387299:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788796567.387318:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27d7ad880 x1875688959290880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796567.387334:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959290880:0@lo:400:kworker.0 00000100:00100000:2.0:1788796567.387793:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959290624:0@lo:400:kworker.0 00000100:00100000:2.0:1788796567.387833:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796567.387877:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959291136:0@lo:400:kworker.0 00000100:00100000:2.0:1788796567.387902:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796567.387918:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796567.387930:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959290752:0@lo:400:kworker.0 00000100:00100000:2.0:1788796567.387949:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796567.388013:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959291136 00000100:00100000:2.0:1788796567.388017:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959291136 00000100:00100000:2.0:1788796567.388057:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788796567.388064:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959291136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796567.388096:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959291136:12345-0@lo:400:kworker.0 Request processed in 33us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796567.388102:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788796567.388126:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788796567.388153:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27d7ad180 x1875688959291136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796567.388163:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959291136:0@lo:400:kworker.0 00000100:00100000:1.0:1788796567.388299:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959290624 00000100:00100000:1.0:1788796567.388308:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959290624 00000100:00100000:1.0:1788796567.388336:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959290752 00000100:00100000:1.0:1788796567.388338:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959290752 00000100:00100000:1.0:1788796567.388363:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788796567.388369:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959290624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796567.388405:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959290624:12345-0@lo:400:kworker.0 Request processed in 36us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796567.388411:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788796567.388423:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788796567.388428:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959290752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796567.388452:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959290752:12345-0@lo:400:kworker.0 Request processed in 25us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796567.388457:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788796567.390039:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796567.390076:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959290752:0@lo:400:kworker.0 00000100:00100000:2.0:1788796567.390087:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959290624:0@lo:400:kworker.0 00000100:00100000:1.0:1788796567.447715:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796567.447811:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796567.447970:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936186880 00000100:00100000:3.0:1788796567.447981:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936186880 00000100:00080000:2.0:1788796567.448031:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796567.448053:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:2.0:1788796567.448058:0:5844:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788796567.448063:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2358:x1875688936186880:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796567.448066:0:5844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788796567.448152:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2358:x1875688936186880:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 90us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796567.448159:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:0.0:1788796567.448278:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936186752 00000100:00100000:0.0:1788796567.448292:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936186752 00000100:00100000:0.0:1788796567.448328:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 207 00000100:00100000:0.0:1788796567.448367:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2358:x1875688936186752:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796567.448411:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2358:x1875688936186752:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 56us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796567.448418:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 207 00000100:00100000:1.0:1788796567.525022:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796567.525805:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936187008 00000100:00100000:3.0:1788796567.525815:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936187008 00000100:00100000:3.0:1788796567.525891:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 208 00000100:00100000:3.0:1788796567.525902:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:8117:x1875688936187008:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788796567.525922:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796567.525940:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d21600/0xdd273c88cfe226e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e82f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796567.525975:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d21600/0xdd273c88cfe226e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e82f expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796567.525988:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d21600/0xdd273c88cfe226e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e82f expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796567.525998:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21600, rc 0) 00000100:00100000:3.0:1788796567.526065:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:8117:x1875688936187008:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 164us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796567.526073:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 208 00000100:00100000:2.0:1788796567.532410:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796567.532619:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936187136 00000100:00100000:3.0:1788796567.532630:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936187136 00000100:00100000:3.0:1788796567.532686:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 209 00000100:00100000:3.0:1788796567.532695:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:8117:x1875688936187136:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788796567.533054:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:8117:x1875688936187136:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 359us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796567.533062:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 209 00000100:00100000:2.0:1788796567.546227:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796567.546340:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936187264 00000100:00100000:0.0:1788796567.546367:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936187264 00000100:00100000:0.0:1788796567.546429:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 210 00000100:00100000:0.0:1788796567.546441:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:8117:x1875688936187264:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788796567.546697:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:8117:x1875688936187264:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 258us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796567.546716:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 210 00000100:00100000:0.0:1788796567.564079:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796567.564644:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936187392 00000100:00100000:1.0:1788796567.564655:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936187392 00000100:00100000:1.0:1788796567.564710:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 211 00000100:00100000:1.0:1788796567.564721:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:8121:x1875688936187392:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788796567.565077:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:8121:x1875688936187392:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 357us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796567.565087:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 211 00000100:00100000:2.0:1788796567.610359:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796567.610475:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936187520 00000100:00100000:3.0:1788796567.610485:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936187520 00000100:00100000:3.0:1788796567.610551:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 212 00000100:00100000:3.0:1788796567.610561:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:8121:x1875688936187520:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788796567.610882:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:8121:x1875688936187520:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 322us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796567.610890:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 212 00000100:00100000:2.0:1788796567.620197:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796567.620308:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936187648 00000100:00100000:0.0:1788796567.620318:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936187648 00000100:00100000:0.0:1788796567.620387:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 213 00000100:00100000:0.0:1788796567.620397:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:8117:x1875688936187648:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788796567.620414:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796567.620431:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe226ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e859 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796567.620459:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe226ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e859 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796567.620471:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe226ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e859 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796567.620479:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240030e00, rc 0) 00000100:00100000:0.0:1788796567.620562:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:8117:x1875688936187648:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 167us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796567.620568:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 213 00000100:00100000:0.0:1788796567.633075:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796567.633172:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936187776 00000100:00100000:1.0:1788796567.633183:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936187776 00000100:00100000:1.0:1788796567.633233:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 214 00000100:00100000:1.0:1788796567.633243:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:8117:x1875688936187776:12345-192.168.201.25@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788796567.633291:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788796567.633308:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788796567.633312:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788796567.633315:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788796567.633317:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788796567.636898:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:8117:x1875688936187776:12345-192.168.201.25@tcp:256:mount.lustre.0 Request processed in 3647us (3823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796567.636913:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 214 00000100:00100000:2.0:1788796567.649871:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796567.649962:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936187904 00000100:00100000:3.0:1788796567.649972:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936187904 00000100:00100000:3.0:1788796567.650026:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 215 00000100:00100000:3.0:1788796567.650036:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:8117:x1875688936187904:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788796567.650052:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796567.650069:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d21800/0xdd273c88cfe226f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e860 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796567.650097:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d21800/0xdd273c88cfe226f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e860 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796567.650108:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d21800/0xdd273c88cfe226f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e860 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796567.650117:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21800, rc 0) 00000100:00100000:3.0:1788796567.650176:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:8117:x1875688936187904:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 141us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796567.650183:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 215 00000100:00100000:2.0:1788796567.655981:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796567.656077:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936188032 00000100:00100000:0.0:1788796567.656087:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936188032 00000100:00100000:0.0:1788796567.656144:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 216 00000100:00100000:0.0:1788796567.656154:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:8117:x1875688936188032:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788796567.657024:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:8117:x1875688936188032:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 869us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796567.657033:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 216 00000100:00100000:2.0:1788796567.661117:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796567.661603:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936188160 00000100:00100000:1.0:1788796567.661612:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936188160 00000100:00100000:1.0:1788796567.661664:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 217 00000100:00100000:1.0:1788796567.661675:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:8117:x1875688936188160:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788796567.661932:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:8117:x1875688936188160:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 257us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796567.661940:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 217 00000100:00100000:2.0:1788796567.666038:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796567.666148:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936188288 00000100:00100000:0.0:1788796567.666158:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936188288 00000100:00100000:0.0:1788796567.666224:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 218 00000100:00100000:0.0:1788796567.666235:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:8126:x1875688936188288:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788796567.666704:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:8126:x1875688936188288:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 469us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796567.666711:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 218 00000100:00100000:2.0:1788796567.673105:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796567.673194:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936188416 00000100:00100000:3.0:1788796567.673214:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936188416 00000100:00100000:3.0:1788796567.673269:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 219 00000100:00100000:3.0:1788796567.673289:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:8126:x1875688936188416:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788796567.673564:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:8126:x1875688936188416:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 286us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796567.673579:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 219 00000100:00100000:2.0:1788796567.685323:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796567.685378:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796567.685602:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936188544 00000100:00100000:1.0:1788796567.685614:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936188544 00000100:00100000:1.0:1788796567.685659:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936188928 00000100:00100000:1.0:1788796567.685662:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936188928 00000100:00100000:1.0:1788796567.685711:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:1.0:1788796567.685724:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936188928:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796567.685839:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936188928:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 118us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796567.685847:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:1.0:1788796567.685867:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:1.0:1788796567.685872:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2354:x1875688936188544:12345-192.168.201.25@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788796567.685904:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7a379f77-5f92-452d-b05c-5aa06b68e964@192.168.201.25@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:1.0:1788796567.685942:0:5846:0:(genops.c:1384:class_connect()) connect: client 7a379f77-5f92-452d-b05c-5aa06b68e964, cookie 0xdd273c88cfe226fa 00000004:00100000:1.0:1788796567.685973:0:5846:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788796567.686243:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9bd27ce2b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788796567.686289:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+6:2354:x1875688936188544:12345-192.168.201.25@tcp:38:mount.lustre.0 Request processed in 401us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796567.686298:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:2.0:1788796567.699897:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796567.699946:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796567.700043:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936188672 00000100:00100000:0.0:1788796567.700053:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936188672 00000100:00100000:0.0:1788796567.700125:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936188800 00000100:00100000:0.0:1788796567.700129:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936188800 00000100:00100000:0.0:1788796567.700153:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:0.0:1788796567.700163:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+7:0:x1875688936188672:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788796567.700206:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788796567.700323:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+7:0:x1875688936188672:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 161us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796567.700353:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:0.0:1788796567.700381:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:0.0:1788796567.700389:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+6:8117:x1875688936188800:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788796567.700402:0:10139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788796567.700426:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+6:8117:x1875688936188800:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 38us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796567.700432:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00080000:2.0:1788796567.700685:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796567.705095:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796567.705184:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936189056 00000100:00100000:0.0:1788796567.705194:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936189056 00000100:00100000:0.0:1788796567.705254:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:0.0:1788796567.705264:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+6:8117:x1875688936189056:12345-192.168.201.25@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788796567.705603:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+6:8117:x1875688936189056:12345-192.168.201.25@tcp:40:mount.lustre.0 Request processed in 340us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796567.705611:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:2.0:1788796567.710159:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796567.710553:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936189440 00000100:00100000:3.0:1788796567.710563:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936189440 00000100:00100000:3.0:1788796567.710620:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:3.0:1788796567.710631:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a379f77-5f92-452d-b05c-5aa06b68e964+6:8117:x1875688936189440:12345-192.168.201.25@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788796567.710717:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788796567.710823:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a379f77-5f92-452d-b05c-5aa06b68e964+6:8117:x1875688936189440:12345-192.168.201.25@tcp:33:mount.lustre.0 Request processed in 192us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796567.710831:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:2.0:1788796567.713061:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796567.713106:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796567.713444:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936189184 00000100:00100000:3.0:1788796567.713455:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936189184 00000100:00100000:3.0:1788796567.713490:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936189312 00000100:00100000:3.0:1788796567.713492:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936189312 00000100:00100000:3.0:1788796567.713513:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:3.0:1788796567.713520:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875688936189184:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788796567.713548:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7a379f77-5f92-452d-b05c-5aa06b68e964@192.168.201.25@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:3.0:1788796567.713575:0:6692:0:(genops.c:1384:class_connect()) connect: client 7a379f77-5f92-452d-b05c-5aa06b68e964, cookie 0xdd273c88cfe22701 00002000:00100000:3.0:1788796567.713587:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7a379f77-5f92-452d-b05c-5aa06b68e964/ffff9bd27d147000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788796567.713610:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788796567.713879:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788796567.713909:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9bd27d145800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788796567.713969:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+6:2354:x1875688936189184:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 448us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796567.713977:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:3.0:1788796567.713993:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:3.0:1788796567.714007:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875688936189312:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788796567.714023:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7a379f77-5f92-452d-b05c-5aa06b68e964@192.168.201.25@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:3.0:1788796567.714037:0:6692:0:(genops.c:1384:class_connect()) connect: client 7a379f77-5f92-452d-b05c-5aa06b68e964, cookie 0xdd273c88cfe22708 00002000:00100000:3.0:1788796567.714042:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7a379f77-5f92-452d-b05c-5aa06b68e964/ffff9bd27d140800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788796567.714055:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788796567.714513:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788796567.714531:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9bd27d141000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788796567.714559:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+6:2354:x1875688936189312:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 551us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796567.714565:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00010000:00010000:0.0:1788796567.898944:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796567.899051:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788796567.899072:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959291264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796567.899144:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796567.900423:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959291264 00000100:00100000:1.0:1788796567.900436:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959291264 00000100:00100000:1.0:1788796567.900494:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788796567.900512:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959291264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796567.900532:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796567.900598:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959291264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796567.900605:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788796567.900699:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27d7ae300 x1875688959291264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796567.900719:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959291264:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788796568.923356:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796569.446335:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788796569.446357:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959291392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788796569.446427:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796569.446491:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959291392 00000100:00100000:1.0:1788796569.446499:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959291392 00000100:00100000:1.0:1788796569.446552:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788796569.446560:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959291392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796569.446591:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796569.446629:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959291392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796569.446648:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788796569.446668:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788796569.446694:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd261294000 x1875688959291392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796585 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796569.446712:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959291392:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788796569.960597:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796570.972679:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788796571.056234:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a379f77-5f92-452d-b05c-5aa06b68e964 00000001:00100000:2.0:1788796571.059417:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a379f77-5f92-452d-b05c-5aa06b68e964 00000001:00100000:2.0:1788796571.542851:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a379f77-5f92-452d-b05c-5aa06b68e964 00010000:00010000:0.0:1788796571.996243:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796572.506289:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959291520:0@lo:400:kworker.0 00000100:00100000:2.0:1788796572.506375:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796572.506583:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959291520 00000100:00100000:3.0:1788796572.506591:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959291520 00000100:00100000:3.0:1788796572.506661:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788796572.506670:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959291520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796572.507084:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959291904:0@lo:400:kworker.0 00000100:00100000:0.0:1788796572.507130:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796572.507167:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959291904 00000100:00100000:0.0:1788796572.507171:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959291904 00000100:00100000:0.0:1788796572.507210:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788796572.507220:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959291904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796572.507258:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959291904:12345-0@lo:400:kworker.0 Request processed in 41us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796572.507279:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788796572.507316:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27e3a9180 x1875688959291904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796572.507343:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959291904:0@lo:400:kworker.0 00000100:00080000:0.0:1788796572.507374:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796572.507397:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959291648:0@lo:400:kworker.0 00000100:00100000:0.0:1788796572.507436:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796572.507457:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796572.507462:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959291776:0@lo:400:kworker.0 00000100:00100000:0.0:1788796572.507497:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796572.507528:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959291648 00000100:00100000:0.0:1788796572.507532:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959291648 00000100:00100000:0.0:1788796572.507558:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959291776 00000100:00100000:0.0:1788796572.507562:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959291776 00000100:00100000:0.0:1788796572.507584:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788796572.507591:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959291648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796572.507636:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959291648:12345-0@lo:400:kworker.0 Request processed in 46us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796572.507642:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788796572.507653:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788796572.507659:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959291776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796572.507684:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959291776:12345-0@lo:400:kworker.0 Request processed in 25us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796572.507689:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788796572.507706:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796572.507730:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959291776:0@lo:400:kworker.0 00000100:00100000:0.0:1788796572.507739:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959291648:0@lo:400:kworker.0 00000100:00100000:3.0:1788796572.525092:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959291520:12345-0@lo:400:kworker.0 Request processed in 18402us (18696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796572.525128:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788796572.525526:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788796572.525540:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959292160:0@lo:400:kworker.0 00000100:00100000:1.0:1788796572.525589:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796572.525681:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959292160 00000100:00100000:2.0:1788796572.525689:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959292160 00000100:00100000:2.0:1788796572.525743:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788796572.525766:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959292160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796572.525829:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959292160:12345-0@lo:400:kworker.0 Request processed in 65us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796572.525836:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788796572.525854:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788796572.525862:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959292032:0@lo:400:kworker.0 00000100:00100000:2.0:1788796572.525901:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796572.525941:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959292032 00000100:00100000:2.0:1788796572.525945:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959292032 00000100:00100000:2.0:1788796572.525973:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788796572.525980:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959292032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796572.526013:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959292032:12345-0@lo:400:kworker.0 Request processed in 34us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796572.526020:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788796572.526057:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959292032:0@lo:400:kworker.0 00010000:00080000:1.0:1788796572.526496:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27e3a8000 x1875688959292160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796572.526508:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959292160:0@lo:400:kworker.0 00000100:00080000:1.0:1788796572.526523:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788796572.526528:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788796572.526843:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959291520:0@lo:400:kworker.0 00010000:00010000:0.0:1788796573.019385:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796573.019910:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959292288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796573.019980:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796573.021827:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959292288 00000100:00100000:0.0:1788796573.021840:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959292288 00000100:00100000:0.0:1788796573.021908:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788796573.021919:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959292288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788796573.021992:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796573.022074:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959292288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (2093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796573.022081:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788796573.022639:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27d7ad180 x1875688959292288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796573.022660:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959292288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796573.062151:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796573.062216:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796573.062265:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796573.062295:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796573.062321:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796573.062502:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936189696 00000100:00100000:0.0:1788796573.062511:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936189696 00000100:00100000:0.0:1788796573.062567:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936189824 00000100:00100000:0.0:1788796573.062570:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936189824 00000100:00100000:0.0:1788796573.062590:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:0.0:1788796573.062598:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936189696:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796573.062679:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936189696:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 81us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796573.062686:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:0.0:1788796573.062705:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:0.0:1788796573.062711:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936189824:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796573.062733:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936189824:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 23us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796573.062887:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:2.0:1788796573.063140:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936189568 00000100:00100000:2.0:1788796573.063145:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936189568 00000100:00100000:2.0:1788796573.063182:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 221 00000100:00100000:2.0:1788796573.063189:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2356:x1875688936189568:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796573.063216:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2356:x1875688936189568:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 28us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796573.063223:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 221 00000100:00100000:2.0:1788796573.063262:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936189952 00000100:00100000:2.0:1788796573.063266:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936189952 00000100:00100000:2.0:1788796573.063293:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936190080 00000100:00100000:2.0:1788796573.063296:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936190080 00000100:00100000:2.0:1788796573.063311:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:2.0:1788796573.063317:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936189952:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796573.063343:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936189952:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 26us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796573.063571:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:2.0:1788796573.063585:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:2.0:1788796573.063591:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936190080:12345-192.168.201.25@tcp:400:kworker.0 00000100:00080000:1.0:1788796573.063773:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788796573.063778:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788796573.063780:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796573.064690:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936190080:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 1093us (2362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796573.064701:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00010000:00010000:0.0:1788796574.045914:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796574.554136:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788796574.554159:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959292416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796574.554237:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796574.554616:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959292416 00000100:00100000:1.0:1788796574.554624:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959292416 00000100:00100000:1.0:1788796574.554696:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788796574.554719:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959292416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796574.554772:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796574.554833:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959292416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796574.554850:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788796574.555040:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267830a80 x1875688959292416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796590 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796574.555061:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959292416:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788796574.555413:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788796575.075320:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788796576.037178:0:10323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788796576.089879:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796577.125232:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796577.628496:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959292928:0@lo:400:kworker.0 00000100:00100000:2.0:1788796577.628564:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796577.628621:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788796577.628639:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959292544:0@lo:400:kworker.0 00000100:00100000:2.0:1788796577.628664:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796577.628692:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959293056:0@lo:400:kworker.0 00000100:00100000:2.0:1788796577.628718:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796577.628778:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959292672:0@lo:400:kworker.0 00000100:00100000:2.0:1788796577.628801:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796577.628820:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959293184:0@lo:400:kworker.0 00000100:00100000:2.0:1788796577.628842:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796577.628855:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796577.628860:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959292800:0@lo:400:kworker.0 00000100:00100000:2.0:1788796577.628876:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796577.628901:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959293056 00000100:00100000:2.0:1788796577.628908:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959293056 00000100:00100000:2.0:1788796577.628951:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959292672 00000100:00100000:2.0:1788796577.628954:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959292672 00000100:00100000:2.0:1788796577.628963:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959292800 00000100:00100000:2.0:1788796577.628976:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959292800 00000100:00100000:2.0:1788796577.629000:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788796577.629007:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959293056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796577.629064:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959293056:12345-0@lo:400:kworker.0 Request processed in 45us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796577.629071:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788796577.629086:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788796577.629092:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959292672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796577.629120:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959292672:12345-0@lo:400:kworker.0 Request processed in 28us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796577.629126:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788796577.629141:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788796577.629147:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959292800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796577.629352:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959292800:12345-0@lo:400:kworker.0 Request processed in 204us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796577.629358:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788796577.629385:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796577.629409:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959292800:0@lo:400:kworker.0 00000100:00100000:2.0:1788796577.629419:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959292672:0@lo:400:kworker.0 00000100:00100000:2.0:1788796577.629443:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959293056:0@lo:400:kworker.0 00000100:00100000:3.0:1788796577.629534:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959292928 00000100:00100000:3.0:1788796577.629538:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959292928 00000100:00100000:3.0:1788796577.629575:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959293184 00000100:00100000:3.0:1788796577.629578:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959293184 00000100:00100000:3.0:1788796577.629592:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788796577.629599:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959292928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796577.629635:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959292928:12345-0@lo:400:kworker.0 Request processed in 37us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796577.629641:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788796577.629651:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788796577.629657:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d50fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959293184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796577.629683:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d50fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959293184:12345-0@lo:400:kworker.0 Request processed in 26us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796577.629689:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788796577.629864:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959292544 00000100:00100000:3.0:1788796577.629868:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959292544 00000100:00100000:3.0:1788796577.629890:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788796577.629897:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959292544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796577.629926:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959292544:12345-0@lo:400:kworker.0 Request processed in 29us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796577.629943:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00010000:00080000:3.0:1788796577.630006:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd25037fb80 x1875688959293184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796577.630018:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959293184:0@lo:400:kworker.0 00000100:00100000:3.0:1788796577.630039:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959292544:0@lo:400:kworker.0 00010000:00080000:3.0:1788796577.630049:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd25037d500 x1875688959292928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796577.630070:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959292928:0@lo:400:kworker.0 00000100:00080000:2.0:1788796577.630239:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788796577.630243:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788796578.137865:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796578.137942:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26130b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959293312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796578.138010:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796578.138117:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959293312 00000100:00100000:1.0:1788796578.138126:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959293312 00000100:00100000:1.0:1788796578.138179:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788796578.138188:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959293312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796578.138221:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796578.138276:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959293312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796578.138283:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788796578.138434:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd26130b800 x1875688959293312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796578.138455:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26130b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959293312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796578.184705:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796578.184764:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796578.184798:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796578.184821:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796578.184849:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796578.184891:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936190592 00000100:00100000:1.0:1788796578.184901:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936190592 00000100:00100000:1.0:1788796578.184956:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936190720 00000100:00100000:1.0:1788796578.184959:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936190720 00000100:00100000:1.0:1788796578.184980:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:1.0:1788796578.184990:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2355:x1875688936190592:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796578.185059:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2355:x1875688936190592:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 71us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796578.185067:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:1.0:1788796578.185099:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:1.0:1788796578.185106:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2355:x1875688936190720:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796578.185146:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2355:x1875688936190720:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 40us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796578.185153:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:1.0:1788796578.185173:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936190208 00000100:00100000:1.0:1788796578.185177:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936190208 00000100:00100000:1.0:1788796578.185202:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 223 00000100:00100000:1.0:1788796578.185208:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2355:x1875688936190208:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796578.185232:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2355:x1875688936190208:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 24us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796578.185238:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 223 00000100:00100000:1.0:1788796578.185265:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936190336 00000100:00100000:1.0:1788796578.185269:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936190336 00000100:00100000:1.0:1788796578.185293:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936190464 00000100:00100000:1.0:1788796578.185296:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936190464 00000100:00100000:1.0:1788796578.185326:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:1.0:1788796578.185334:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2355:x1875688936190336:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796578.185362:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2355:x1875688936190336:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 29us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796578.185368:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:1.0:1788796578.185379:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:1.0:1788796578.185385:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2355:x1875688936190464:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796578.185409:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2355:x1875688936190464:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 24us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796578.185425:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00080000:1.0:1788796578.185445:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788796578.185450:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788796578.185452:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788796579.162130:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796579.675043:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788796579.675074:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959293440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788796579.675137:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796579.676010:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959293440 00000100:00100000:0.0:1788796579.676030:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959293440 00000100:00100000:0.0:1788796579.676100:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788796579.676111:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959293440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796579.676144:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796579.676196:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959293440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796579.676202:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788796579.676636:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788796579.676674:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267832d80 x1875688959293440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796595 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796579.676697:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959293440:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788796580.186230:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796581.210359:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796582.236182:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796582.746114:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959293824:0@lo:400:kworker.0 00000100:00100000:1.0:1788796582.746184:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796582.746261:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788796582.746269:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959293696:0@lo:400:kworker.0 00000100:00100000:1.0:1788796582.746293:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796582.746311:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959294208:0@lo:400:kworker.0 00000100:00100000:1.0:1788796582.746335:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796582.746369:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959293824 00000100:00100000:1.0:1788796582.746378:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959293824 00000100:00100000:1.0:1788796582.746425:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959293696 00000100:00100000:1.0:1788796582.746429:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959293696 00000100:00100000:1.0:1788796582.746452:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788796582.746462:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959293824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796582.746521:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959293824:12345-0@lo:400:kworker.0 Request processed in 61us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796582.746543:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788796582.746563:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788796582.746570:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959293696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796582.746602:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959293696:12345-0@lo:400:kworker.0 Request processed in 33us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796582.746608:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788796582.746634:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959294208 00000100:00100000:1.0:1788796582.746637:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959294208 00000100:00100000:1.0:1788796582.746667:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788796582.746674:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959294208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796582.746706:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959294208:12345-0@lo:400:kworker.0 Request processed in 33us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796582.746712:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788796582.746729:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788796582.746734:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796582.746830:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959293696:0@lo:400:kworker.0 00010000:00080000:1.0:1788796582.746845:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267831500 x1875688959294208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796582.746855:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959294208:0@lo:400:kworker.0 00000100:00100000:1.0:1788796582.746865:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959293824:0@lo:400:kworker.0 00000100:00100000:2.0:1788796582.747028:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959293568:0@lo:400:kworker.0 00000100:00100000:2.0:1788796582.747065:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796582.747102:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959294080:0@lo:400:kworker.0 00000100:00100000:2.0:1788796582.747123:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796582.747141:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788796582.747147:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959293952:0@lo:400:kworker.0 00000100:00100000:2.0:1788796582.747167:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796582.747194:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959293952 00000100:00100000:2.0:1788796582.747198:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959293952 00000100:00100000:2.0:1788796582.747255:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788796582.747262:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959293952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796582.747293:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959293952:12345-0@lo:400:kworker.0 Request processed in 33us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796582.747299:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788796582.747318:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788796582.747335:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267832680 x1875688959293952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796582.747345:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959293952:0@lo:400:kworker.0 00000100:00100000:2.0:1788796582.747359:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959294080 00000100:00100000:2.0:1788796582.747362:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959294080 00000100:00100000:2.0:1788796582.747387:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788796582.747392:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959294080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796582.747419:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959294080:12345-0@lo:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796582.747425:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788796582.747436:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796582.747448:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959294080:0@lo:400:kworker.0 00000100:00100000:1.0:1788796582.747585:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959293568 00000100:00100000:1.0:1788796582.747589:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959293568 00000100:00100000:1.0:1788796582.747619:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788796582.747626:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959293568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796582.747675:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959293568:12345-0@lo:400:kworker.0 Request processed in 50us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796582.747681:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788796582.747743:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959293568:0@lo:400:kworker.0 00000100:00100000:0.0:1788796583.261822:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796583.261844:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959294336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796583.261904:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788796583.261954:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796583.261966:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959294336 00000100:00100000:0.0:1788796583.261973:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959294336 00000100:00100000:0.0:1788796583.262032:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788796583.262042:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959294336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788796583.262073:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796583.262113:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959294336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796583.262132:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788796583.262169:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27d7aea00 x1875688959294336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796583.262186:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959294336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796583.308401:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796583.308437:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796583.308468:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796583.308492:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796583.308511:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796583.308537:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936191360 00000100:00100000:0.0:1788796583.308547:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936191360 00000100:00100000:0.0:1788796583.308597:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936191232 00000100:00100000:0.0:1788796583.308600:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936191232 00000100:00100000:0.0:1788796583.308615:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:0.0:1788796583.308627:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2357:x1875688936191360:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796583.308691:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2357:x1875688936191360:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 68us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796583.308699:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:0.0:1788796583.308714:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:0.0:1788796583.308720:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2357:x1875688936191232:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796583.308738:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2357:x1875688936191232:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 19us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796583.308781:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00080000:0.0:1788796583.308796:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788796583.308800:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788796583.308872:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936190848 00000100:00100000:1.0:1788796583.308877:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936190848 00000100:00100000:1.0:1788796583.308909:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 225 00000100:00100000:1.0:1788796583.308916:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2357:x1875688936190848:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796583.308942:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2357:x1875688936190848:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 28us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796583.308948:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 225 00000100:00100000:1.0:1788796583.308973:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936191104 00000100:00100000:1.0:1788796583.308976:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936191104 00000100:00100000:1.0:1788796583.309017:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936190976 00000100:00100000:1.0:1788796583.309020:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936190976 00000100:00100000:1.0:1788796583.309040:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:1.0:1788796583.309045:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2357:x1875688936191104:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796583.309080:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2357:x1875688936191104:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 25us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796583.309086:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:1.0:1788796583.309096:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:1.0:1788796583.309102:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2357:x1875688936190976:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796583.309120:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2357:x1875688936190976:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 19us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796583.309126:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00080000:1.0:1788796583.309257:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788796584.282250:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796584.794418:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788796584.794437:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959294464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796584.794496:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796584.794706:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959294464 00000100:00100000:1.0:1788796584.794714:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959294464 00000100:00100000:1.0:1788796584.794803:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788796584.794813:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959294464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796584.794844:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796584.794888:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959294464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796584.794894:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788796584.794929:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267832300 x1875688959294464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796600 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796584.794947:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959294464:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788796584.795035:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788796585.306668:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796586.331608:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796587.356109:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796587.870603:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788796587.870631:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959294592:0@lo:400:kworker.0 00000100:00100000:0.0:1788796587.870706:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796587.870793:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959294720:0@lo:400:kworker.0 00000100:00100000:2.0:1788796587.871845:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959294592 00000100:00100000:2.0:1788796587.871862:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959294592 00000100:00100000:2.0:1788796587.871929:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788796587.871940:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959294592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796587.872014:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959294592:12345-0@lo:400:kworker.0 Request processed in 77us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796587.872022:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788796587.872172:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959294592:0@lo:400:kworker.0 00000100:00100000:0.0:1788796587.876729:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796587.877101:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959294720 00000100:00100000:0.0:1788796587.877113:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959294720 00000100:00100000:0.0:1788796587.877200:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788796587.877210:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959294720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796587.877269:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959294720:12345-0@lo:400:kworker.0 Request processed in 61us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796587.877277:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788796587.877323:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959294720:0@lo:400:kworker.0 00000100:00100000:0.0:1788796587.879590:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959294976:0@lo:400:kworker.0 00000100:00100000:0.0:1788796587.879648:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796587.879694:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959294976 00000100:00100000:0.0:1788796587.879701:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959294976 00000100:00100000:0.0:1788796587.879768:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788796587.879778:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959294976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796587.879892:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788796587.879902:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959294848:0@lo:400:kworker.0 00000100:00080000:3.0:1788796587.880836:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788796587.889250:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796587.889604:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959294848 00000100:00100000:2.0:1788796587.889614:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959294848 00000100:00100000:0.0:1788796587.889675:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959294976:12345-0@lo:400:kworker.0 Request processed in 9898us (10024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796587.889682:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788796587.889687:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788796587.889690:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959294848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796587.889769:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959294848:12345-0@lo:400:kworker.0 Request processed in 80us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796587.889776:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1788796587.890288:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd261295500 x1875688959294976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796587.890305:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959294976:0@lo:400:kworker.0 00000100:00080000:3.0:1788796587.890476:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796587.892980:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796587.893015:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959295232:0@lo:400:kworker.0 00000100:00100000:3.0:1788796587.893088:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796587.893138:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959295232 00000100:00100000:3.0:1788796587.893158:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959295232 00000100:00100000:3.0:1788796587.893214:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788796587.893223:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959295232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796587.893274:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959295232:12345-0@lo:400:kworker.0 Request processed in 52us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796587.893281:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788796587.893312:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959295104:0@lo:400:kworker.0 00000100:00100000:3.0:1788796587.893337:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796587.893384:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959295104 00000100:00100000:3.0:1788796587.893389:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959295104 00000100:00100000:3.0:1788796587.893421:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788796587.893428:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959295104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796587.893464:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959295104:12345-0@lo:400:kworker.0 Request processed in 37us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796587.893470:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788796587.893493:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788796587.893498:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788796587.893526:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959295104:0@lo:400:kworker.0 00010000:00080000:3.0:1788796587.893556:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd261296300 x1875688959295232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796587.893568:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959295232:0@lo:400:kworker.0 00000100:00100000:1.0:1788796587.898165:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959294848:0@lo:400:kworker.0 00010000:00010000:0.0:1788796588.380811:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796588.381068:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959295360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796588.381134:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796588.382859:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959295360 00000100:00100000:0.0:1788796588.382880:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959295360 00000100:00100000:0.0:1788796588.382943:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788796588.382952:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959295360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788796588.382987:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796588.383060:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959295360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796588.383067:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788796588.383117:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd261294000 x1875688959295360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796588.383151:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959295360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796588.421645:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796588.421697:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796588.421735:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796588.421794:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936191616 00000100:00100000:1.0:1788796588.421804:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936191616 00000100:00100000:1.0:1788796588.421855:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936191744 00000100:00100000:1.0:1788796588.421859:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936191744 00000100:00100000:1.0:1788796588.421883:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:1.0:1788796588.421907:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2357:x1875688936191616:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796588.421988:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2357:x1875688936191616:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 83us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796588.421996:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:1.0:1788796588.422014:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:1.0:1788796588.422021:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2357:x1875688936191744:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796588.422046:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2357:x1875688936191744:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 26us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796588.422053:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:3.0:1788796588.422395:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936191488 00000100:00100000:3.0:1788796588.422401:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936191488 00000100:00100000:3.0:1788796588.422433:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 227 00000100:00100000:3.0:1788796588.422441:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2357:x1875688936191488:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796588.422475:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2357:x1875688936191488:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 35us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796588.422481:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 227 00000100:00080000:3.0:1788796588.422508:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796588.422545:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796588.422612:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796588.422631:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936191872 00000100:00100000:3.0:1788796588.422635:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936191872 00000100:00100000:3.0:1788796588.422681:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936192000 00000100:00100000:3.0:1788796588.422685:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936192000 00000100:00100000:3.0:1788796588.422703:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:3.0:1788796588.422709:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2354:x1875688936191872:12345-192.168.201.25@tcp:9:kworker.0 00000020:00000080:3.0:1788796588.422729:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22701 00000100:00080000:3.0:1788796588.422739:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9bd27d145800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788796588.422834:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788796588.423258:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+2:2354:x1875688936191872:12345-192.168.201.25@tcp:9:kworker.0 Request processed in 546us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796588.423265:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:3.0:1788796588.423280:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:3.0:1788796588.423288:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2354:x1875688936192000:12345-192.168.201.25@tcp:9:kworker.0 00000020:00000080:3.0:1788796588.423301:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22708 00000100:00080000:3.0:1788796588.423308:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9bd27d141000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788796588.423332:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788796588.423526:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+2:2354:x1875688936192000:12345-192.168.201.25@tcp:9:kworker.0 Request processed in 237us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796588.423533:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00010000:00010000:3.0:1788796588.423616:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788796588.423623:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788796588.423626:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788796588.423632:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796589.401915:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796589.915831:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788796589.915863:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959295488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796589.915966:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796589.916166:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959295488 00000100:00100000:1.0:1788796589.916175:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959295488 00000100:00100000:1.0:1788796589.916250:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788796589.916261:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261294000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959295488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796589.916297:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796589.916481:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261294000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959295488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 222us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796589.916488:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788796589.916557:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788796589.916588:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267832d80 x1875688959295488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796589.916609:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959295488:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788796590.430512:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796591.451396:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788796591.516732:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a379f77-5f92-452d-b05c-5aa06b68e964 00000020:00000080:2.0:1788796591.516742:0:6716:0:(genops.c:885:class_export_put()) final put ffff9bd27d147000/7a379f77-5f92-452d-b05c-5aa06b68e964 00000020:00000080:1.0:1788796591.516837:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27d147000/7a379f77-5f92-452d-b05c-5aa06b68e964 for lustre-OST0000 00000020:00000080:1.0:1788796591.516880:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd27d145800 for lustre-OST0000 00000001:00100000:2.0:1788796591.552486:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a379f77-5f92-452d-b05c-5aa06b68e964 00000020:00000080:2.0:1788796591.552493:0:7649:0:(genops.c:885:class_export_put()) final put ffff9bd27d140800/7a379f77-5f92-452d-b05c-5aa06b68e964 00000020:00000080:3.0:1788796591.552539:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27d140800/7a379f77-5f92-452d-b05c-5aa06b68e964 for lustre-OST0001 00000020:00000080:3.0:1788796591.552582:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd27d141000 for lustre-OST0001 00010000:00010000:1.0:1788796592.476548:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796592.986221:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959295616:0@lo:400:kworker.0 00000100:00100000:0.0:1788796592.986300:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796592.986353:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959296128:0@lo:400:kworker.0 00000100:00100000:0.0:1788796592.986381:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796592.986412:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788796592.986418:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959296000:0@lo:400:kworker.0 00000100:00100000:0.0:1788796592.986440:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796592.986465:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959295872:0@lo:400:kworker.0 00000100:00100000:0.0:1788796592.986496:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796592.986515:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788796592.986521:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959295744:0@lo:400:kworker.0 00000100:00100000:0.0:1788796592.986553:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796592.986573:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959296256:0@lo:400:kworker.0 00000100:00100000:0.0:1788796592.986592:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796592.986616:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959296128 00000100:00100000:0.0:1788796592.986623:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959296128 00000100:00100000:0.0:1788796592.986666:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959295872 00000100:00100000:0.0:1788796592.986668:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959295872 00000100:00100000:0.0:1788796592.986678:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959295744 00000100:00100000:0.0:1788796592.986680:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959295744 00000100:00100000:0.0:1788796592.986692:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788796592.986699:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959296128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796592.987482:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959296128:12345-0@lo:400:kworker.0 Request processed in 779us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796592.987492:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788796592.987517:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788796592.987525:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959295872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796592.987784:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959296000 00000100:00100000:1.0:1788796592.987790:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959296000 00000100:00100000:1.0:1788796592.987824:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959296256 00000100:00100000:1.0:1788796592.987826:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959296256 00000100:00100000:1.0:1788796592.987840:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788796592.987846:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959296000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796592.987889:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959296000:12345-0@lo:400:kworker.0 Request processed in 43us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796592.987896:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788796592.987907:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788796592.987914:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959296256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796592.987973:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959295872:12345-0@lo:400:kworker.0 Request processed in 449us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796592.987980:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788796592.987991:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788796592.987997:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959295744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796592.988071:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959295616 00000100:00100000:3.0:1788796592.988076:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959295616 00000100:00100000:3.0:1788796592.988102:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788796592.988118:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959295616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796592.988150:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959295616:12345-0@lo:400:kworker.0 Request processed in 34us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796592.988156:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788796592.991503:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959296256:12345-0@lo:400:kworker.0 Request processed in 3581us (4900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796592.991516:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788796592.992207:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788796592.992213:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788796592.992217:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788796592.993892:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd25037f480 x1875688959296000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796592.993910:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959296000:0@lo:400:kworker.0 00000100:00100000:1.0:1788796592.993921:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959295616:0@lo:400:kworker.0 00000100:00100000:1.0:1788796592.993932:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959296128:0@lo:400:kworker.0 00000100:00100000:0.0:1788796592.994091:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959295744:12345-0@lo:400:kworker.0 Request processed in 6090us (7534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796592.994841:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788796592.996990:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959295872:0@lo:400:kworker.0 00000100:00100000:2.0:1788796592.997021:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959295744:0@lo:400:kworker.0 00010000:00080000:2.0:1788796592.997035:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd25037ed80 x1875688959296256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796592.997046:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959296256:0@lo:400:kworker.0 00010000:00010000:0.0:1788796593.498427:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796593.499064:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796593.499085:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959296384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796593.499161:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796593.499953:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959296384 00000100:00100000:1.0:1788796593.499966:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959296384 00000100:00100000:1.0:1788796593.500021:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788796593.500031:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959296384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796593.500079:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788796593.500153:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959296384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796593.500161:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788796593.500202:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd261308a80 x1875688959296384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796593.500233:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959296384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796593.542210:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796593.542255:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796593.542289:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796593.542362:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936192128 00000100:00100000:2.0:1788796593.542373:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936192128 00000100:00100000:2.0:1788796593.542426:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 229 00000100:00100000:2.0:1788796593.542435:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2355:x1875688936192128:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796593.542518:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2355:x1875688936192128:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 84us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796593.542526:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 229 00000100:00100000:0.0:1788796593.542726:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936192384 00000100:00100000:0.0:1788796593.542731:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936192384 00000100:00100000:0.0:1788796593.542804:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936192256 00000100:00100000:0.0:1788796593.542808:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936192256 00000100:00100000:0.0:1788796593.542830:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 89 00000100:00100000:0.0:1788796593.542837:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2355:x1875688936192384:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796593.542873:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2355:x1875688936192384:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 36us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796593.542880:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 89 00000100:00100000:0.0:1788796593.542893:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:0.0:1788796593.542899:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2355:x1875688936192256:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796593.542922:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2355:x1875688936192256:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 23us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796593.542927:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00080000:2.0:1788796593.542993:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788796594.521969:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796595.040108:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959296512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796595.040189:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796595.040551:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959296512 00000100:00100000:1.0:1788796595.040559:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959296512 00000100:00100000:1.0:1788796595.040636:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788796595.040647:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959296512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796595.040683:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796595.040730:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959296512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796595.040736:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788796595.041033:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267830e00 x1875688959296512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796595.041057:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959296512:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788796595.041190:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788796595.546906:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788796595.699197:0:11025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788796596.569966:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796597.594078:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796598.107318:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959296640:0@lo:400:kworker.0 00000100:00100000:0.0:1788796598.107388:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796598.108221:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959296640 00000100:00100000:3.0:1788796598.108236:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959296640 00000100:00100000:3.0:1788796598.108294:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788796598.108305:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959296640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796598.108796:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959296896:0@lo:400:kworker.0 00000100:00100000:2.0:1788796598.108833:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796598.108864:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788796598.108869:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959296768:0@lo:400:kworker.0 00000100:00100000:2.0:1788796598.108891:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796598.108917:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959297024:0@lo:400:kworker.0 00000100:00100000:2.0:1788796598.108942:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796598.108980:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959296896 00000100:00100000:2.0:1788796598.108985:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959296896 00000100:00100000:2.0:1788796598.109021:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959296768 00000100:00100000:2.0:1788796598.109024:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959296768 00000100:00100000:2.0:1788796598.109044:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788796598.109051:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959296896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796598.109103:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959296896:12345-0@lo:400:kworker.0 Request processed in 52us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796598.109110:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788796598.109127:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788796598.109133:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959296768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796598.109158:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959296768:12345-0@lo:400:kworker.0 Request processed in 26us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796598.109164:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788796598.109184:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959297024 00000100:00100000:2.0:1788796598.109187:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959297024 00000100:00100000:2.0:1788796598.109214:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788796598.109220:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959297024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796598.109252:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959297024:12345-0@lo:400:kworker.0 Request processed in 32us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796598.109265:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788796598.109281:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788796598.109286:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788796598.109318:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267830a80 x1875688959297024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796598.109332:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959297024:0@lo:400:kworker.0 00000100:00100000:2.0:1788796598.109358:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959296768:0@lo:400:kworker.0 00000100:00100000:2.0:1788796598.109367:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959296896:0@lo:400:kworker.0 00000100:00100000:3.0:1788796598.109879:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959296640:12345-0@lo:400:kworker.0 Request processed in 1575us (2489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796598.109887:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788796598.112147:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959296640:0@lo:400:kworker.0 00000100:00100000:1.0:1788796598.112498:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959297280:0@lo:400:kworker.0 00000100:00100000:1.0:1788796598.112552:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796598.112596:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959297280 00000100:00100000:1.0:1788796598.112603:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959297280 00000100:00100000:1.0:1788796598.112655:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788796598.112663:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959297280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796598.112707:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959297280:12345-0@lo:400:kworker.0 Request processed in 45us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796598.112714:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788796598.112734:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788796598.112773:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267833100 x1875688959297280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796598.112786:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959297280:0@lo:400:kworker.0 00000100:00100000:1.0:1788796598.112800:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788796598.112807:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959297152:0@lo:400:kworker.0 00000100:00100000:1.0:1788796598.113081:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796598.113319:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959297152 00000100:00100000:3.0:1788796598.113325:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959297152 00000100:00100000:3.0:1788796598.113370:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788796598.113378:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959297152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796598.113416:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959297152:12345-0@lo:400:kworker.0 Request processed in 40us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796598.113422:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788796598.113453:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959297152:0@lo:400:kworker.0 00000100:00080000:1.0:1788796598.113556:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788796598.620310:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796598.627113:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26130a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959297408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796598.627198:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796598.627276:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959297408 00000100:00100000:0.0:1788796598.627284:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959297408 00000100:00100000:0.0:1788796598.627327:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788796598.627337:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959297408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788796598.627373:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788796598.627415:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959297408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796598.627423:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788796598.627471:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd26130a300 x1875688959297408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796598.627488:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26130a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959297408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796598.680280:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796598.680376:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796598.680417:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796598.680448:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936192768 00000100:00100000:1.0:1788796598.680458:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936192768 00000100:00100000:1.0:1788796598.680519:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936192640 00000100:00100000:1.0:1788796598.680522:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936192640 00000100:00100000:1.0:1788796598.680547:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:1.0:1788796598.680557:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2357:x1875688936192768:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796598.680630:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2357:x1875688936192768:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 75us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796598.680638:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:1.0:1788796598.680654:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 95 00000100:00100000:1.0:1788796598.680661:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2357:x1875688936192640:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796598.680684:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2357:x1875688936192640:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 24us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796598.680690:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 95 00000100:00080000:1.0:1788796598.680711:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796598.685386:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936192512 00000100:00100000:3.0:1788796598.685400:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936192512 00000100:00100000:3.0:1788796598.685480:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 231 00000100:00100000:3.0:1788796598.685490:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2357:x1875688936192512:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796598.685561:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2357:x1875688936192512:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 72us (5289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796598.685568:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 231 00010000:00010000:0.0:1788796599.644883:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788796599.739397:0:11173:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd8d909e0 20000000:00000080:1.0:1788796599.739417:0:11173:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd27e815000 uarg=0000000000000000 20000000:01000000:1.0:1788796599.739455:0:11173:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788796599.739461:0:11173:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788796599.739467:0:11173:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788796599.740741:0:11174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788796599.741065:0:11173:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788796599.752526:0:11173:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788796599.752557:0:11173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd240030200/0xdd273c88cfe2270f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.752576:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe22675 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2266e expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.752588:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd282052200/0xdd273c88cfe2268a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e828 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.752597:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe226a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2269f expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.752604:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd267335c00/0xdd273c88cfe226d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe226c9 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.752630:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd247d21800/0xdd273c88cfe226f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e860 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.752637:0:11173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd240030200/0xdd273c88cfe2270f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.752679:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd247d21800/0xdd273c88cfe226f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e860 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.752697:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd247d21800/0xdd273c88cfe226f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e860 expref: 12 pid: 5837 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796599.752711:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a37800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875688959297536:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796599.756069:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd267335c00/0xdd273c88cfe226d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe226c9 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.756089:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd267335c00/0xdd273c88cfe226d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe226c9 expref: 18 pid: 5838 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796599.756105:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a34380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875688959297664:0@lo:104: 00000100:00100000:0.0:1788796599.756160:0:11173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788796599.756195:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe226a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe2269f expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.756205:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe226a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe2269f expref: 18 pid: 5837 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796599.756214:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a34a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875688959297792:0@lo:104: 00000100:00100000:0.0:1788796599.756249:0:11173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788796599.756278:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd282052200/0xdd273c88cfe2268a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e828 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.756288:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd282052200/0xdd273c88cfe2268a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e828 expref: 12 pid: 5838 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796599.756298:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a35f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875688959297920:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796599.756327:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe22675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe2266e expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.756335:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe22675 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe2266e expref: 18 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796599.756343:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a37480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875688959298048:0@lo:104: 00000100:00100000:0.0:1788796599.756363:0:11173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796599.756377:0:11173:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb78480 going to sleep for 11 seconds 00000100:00100000:1.0:1788796599.756663:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959297664 00000100:00100000:1.0:1788796599.756677:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959297664 00000100:00100000:1.0:1788796599.756716:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959297792 00000100:00100000:1.0:1788796599.756719:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959297792 00000100:00100000:1.0:1788796599.756730:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959298048 00000100:00100000:1.0:1788796599.756732:0:8456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959298048 00000100:00100000:1.0:1788796599.756774:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788796599.756794:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7f7145a2-0840-45a5-acde-da959fc7802f+5:11173:x1875688959297664:12345-0@lo:104: 00010000:00010000:1.0:1788796599.756807:0:8456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe226c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe226d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.756858:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788796599.756864:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7f7145a2-0840-45a5-acde-da959fc7802f+5:11173:x1875688959297664:12345-0@lo:104: Request processed in 72us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796599.756871:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788796599.756887:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788796599.756894:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7f7145a2-0840-45a5-acde-da959fc7802f+4:11173:x1875688959297792:12345-0@lo:104: 00010000:00010000:1.0:1788796599.756902:0:8456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2269f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe226a6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.756935:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788796599.756954:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7f7145a2-0840-45a5-acde-da959fc7802f+4:11173:x1875688959297792:12345-0@lo:104: Request processed in 61us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796599.756960:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788796599.756971:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788796599.756976:0:8456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7f7145a2-0840-45a5-acde-da959fc7802f+3:11173:x1875688959298048:12345-0@lo:104: 00010000:00010000:1.0:1788796599.756983:0:8456:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe2266e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22675 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757007:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788796599.757018:0:8456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7f7145a2-0840-45a5-acde-da959fc7802f+3:11173:x1875688959298048:12345-0@lo:104: Request processed in 42us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796599.757023:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788796599.757039:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788796599.757045:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe226c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe226d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757052:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031600 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:1.0:1788796599.757056:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe226c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe226d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757064:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe226c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe226d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796599.757072:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe226c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe226d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796599.757077:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788796599.757105:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe226c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe226d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757110:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796599.757140:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe226c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe226d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757147:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd240031600/0xdd273c88cfe226c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe226d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757161:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788796599.757164:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2269f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe226a6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757180:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152fc00 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:1.0:1788796599.757183:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2269f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe226a6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757189:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2269f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe226a6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796599.757196:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2269f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe226a6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796599.757200:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788796599.757215:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2269f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe226a6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757221:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796599.757227:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2269f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe226a6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757234:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd24152fc00/0xdd273c88cfe2269f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe226a6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757243:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796599.757246:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe2266e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22675 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757252:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152f600 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:1.0:1788796599.757255:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe2266e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe22675 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757272:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe2266e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe22675 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796599.757278:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe2266e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe22675 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796599.757283:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788796599.757296:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe2266e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22675 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757301:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796599.757318:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe2266e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22675 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757324:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd24152f600/0xdd273c88cfe2266e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22675 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757338:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796599.757339:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796599.757341:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796599.757347:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796599.757358:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959298304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796599.757391:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796599.757420:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788796599.757426:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959298176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796599.757461:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796599.757489:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959298432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796599.757511:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796599.757551:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959298304 00000100:00100000:1.0:1788796599.757557:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959298304 00010000:00010000:1.0:1788796599.757578:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe226a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2269f expref: 19 pid: 5837 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796599.757597:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959298176 00000100:00100000:1.0:1788796599.757600:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959298176 00010000:00010000:1.0:1788796599.757610:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd267335c00/0xdd273c88cfe226d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe226c9 expref: 20 pid: 5838 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796599.757619:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959298432 00000100:00100000:1.0:1788796599.757621:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959298432 00010000:00010000:1.0:1788796599.757629:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe22675 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2266e expref: 21 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796599.757640:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788796599.757645:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd245993450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+21:3307:x1875688959298304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788796599.757655:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796599.757660:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe226a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2269f expref: 21 pid: 5837 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757669:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe226a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe2269f expref: 21 pid: 5837 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757684:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796599.757712:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd245993450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+21:3307:x1875688959298304:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796599.757718:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788796599.757785:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788796599.757791:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+20:3307:x1875688959298176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788796599.757806:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796599.757810:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd267335c00/0xdd273c88cfe226d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe226c9 expref: 20 pid: 5838 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757819:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd267335c00/0xdd273c88cfe226d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe226c9 expref: 20 pid: 5838 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757828:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796599.757849:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+20:3307:x1875688959298176:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796599.757855:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788796599.757868:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788796599.757874:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3304:x1875688959298432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788796599.757881:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796599.757884:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe22675 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2266e expref: 19 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757892:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe22675 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe2266e expref: 19 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796599.757901:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796599.757926:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3304:x1875688959298432:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796599.757932:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788796599.757984:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959298432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796599.758010:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959298176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796599.758018:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959298304:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788796599.758950:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd267335c00/0xdd273c88cfe226d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe226c9 expref: 18 pid: 5838 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796599.758967:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a34380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875688959297664:0@lo:104: 00010000:00010000:0.0:1788796599.758980:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe226a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe2269f expref: 17 pid: 5837 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796599.758989:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a34a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875688959297792:0@lo:104: 00010000:00010000:0.0:1788796599.758999:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe22675 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe2266e expref: 16 pid: 5839 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796599.759008:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a37480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875688959298048:0@lo:104: 00000100:00100000:0.0:1788796599.764214:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a37800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875688959297536:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788796599.764231:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a35f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875688959297920:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796599.764270:0:11173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd240030200/0xdd273c88cfe2270f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796599.765560:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796599.765602:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796599.765722:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936192896 00000100:00100000:0.0:1788796599.765732:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936192896 00010000:00010000:0.0:1788796599.765803:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd247d21800/0xdd273c88cfe226f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e860 expref: 13 pid: 5837 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796599.765835:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936193024 00000100:00100000:0.0:1788796599.765838:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936193024 00010000:00010000:0.0:1788796599.765852:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd282052200/0xdd273c88cfe2268a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e828 expref: 14 pid: 5838 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796599.765879:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:0.0:1788796599.765889:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:039faa1e-567a-467b-be0f-2f39bb0eb94e+14:2358:x1875688936192896:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796599.765904:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796599.765910:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd247d21800/0xdd273c88cfe226f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e860 expref: 14 pid: 5837 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.765922:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd247d21800/0xdd273c88cfe226f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e860 expref: 14 pid: 5837 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.765952:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d21800/0xdd273c88cfe226f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e860 expref: 14 pid: 5837 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.765968:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796599.766016:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936192896:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 128us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796599.766036:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:0.0:1788796599.766053:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:0.0:1788796599.766059:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:2358:x1875688936193024:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796599.766068:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796599.766073:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd282052200/0xdd273c88cfe2268a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e828 expref: 12 pid: 5838 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.766082:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd282052200/0xdd273c88cfe2268a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e828 expref: 12 pid: 5838 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.766093:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd282052200/0xdd273c88cfe2268a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e828 expref: 12 pid: 5838 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.766104:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd240030200/0xdd273c88cfe2270f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.766113:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd240030200/0xdd273c88cfe2270f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.766129:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd240030200/0xdd273c88cfe2270f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.766136:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd240030200/0xdd273c88cfe2270f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.766142:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd240030200/0xdd273c88cfe2270f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.766150:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd240030200/0xdd273c88cfe2270f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.766162:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240030200 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796599.766166:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd240030200/0xdd273c88cfe2270f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.766175:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd240030200/0xdd273c88cfe2270f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.766191:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd240030200/0xdd273c88cfe2270f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.766203:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796599.766223:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:2358:x1875688936193024:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 164us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796599.766229:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 29 00010000:00010000:0.0:1788796599.766255:0:11173:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd240030200/0xdd273c88cfe2270f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.766263:0:11173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd240030200/0xdd273c88cfe2270f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796599.766269:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd240030200/0xdd273c88cfe2270f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796600.154103:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959298560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796600.154177:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796600.154309:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959298560 00000100:00100000:1.0:1788796600.154317:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959298560 00000100:00100000:1.0:1788796600.154380:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788796600.154391:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959298560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796600.154425:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796600.154479:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959298560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796600.154486:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788796600.154508:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd247d27100 x1875688959298560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796600.154531:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959298560:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788796600.154649:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788796600.666864:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796601.029637:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796601.029742:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936193152 00000100:00100000:3.0:1788796601.029777:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936193152 00000100:00100000:3.0:1788796601.029824:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 232 00000100:00100000:3.0:1788796601.029836:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:5599:x1875688936193152:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796601.029864:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796601.029886:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d21c00/0xdd273c88cfe22716 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e88a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796601.029914:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d21c00/0xdd273c88cfe22716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e88a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796601.029937:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d21c00/0xdd273c88cfe22716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e88a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796601.029946:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21c00, rc 0) 00000100:00100000:3.0:1788796601.030011:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:5599:x1875688936193152:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 176us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796601.030018:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 232 00000100:00100000:2.0:1788796601.040005:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796601.041023:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936193280 00000100:00100000:0.0:1788796601.041037:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936193280 00000100:00100000:0.0:1788796601.041104:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 233 00000100:00100000:0.0:1788796601.041115:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:5599:x1875688936193280:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796601.041623:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:5599:x1875688936193280:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 508us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796601.041632:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 233 00000100:00100000:1.0:1788796601.061431:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796601.061516:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936193408 00000100:00100000:0.0:1788796601.061527:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936193408 00000100:00100000:0.0:1788796601.061582:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 234 00000100:00100000:0.0:1788796601.061592:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:5599:x1875688936193408:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796601.061828:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:5599:x1875688936193408:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 237us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796601.061836:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 234 00000100:00100000:3.0:1788796601.071148:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796601.071193:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936193536 00000100:00100000:3.0:1788796601.071204:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936193536 00000100:00100000:3.0:1788796601.071251:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 235 00000100:00100000:3.0:1788796601.071261:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:5599:x1875688936193536:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796601.071282:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796601.071304:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d20800/0xdd273c88cfe2271d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e891 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796601.071333:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d20800/0xdd273c88cfe2271d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e891 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796601.071345:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d20800/0xdd273c88cfe2271d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e891 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796601.071367:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20800, rc 0) 00000100:00100000:3.0:1788796601.071445:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:5599:x1875688936193536:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 185us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796601.071452:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 235 00000100:00100000:2.0:1788796601.087212:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796601.087313:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936193664 00000100:00100000:1.0:1788796601.087326:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936193664 00000100:00100000:1.0:1788796601.087413:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 236 00000100:00100000:1.0:1788796601.087424:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:5599:x1875688936193664:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796601.087720:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:5599:x1875688936193664:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 297us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796601.087728:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 236 00000100:00100000:3.0:1788796601.090128:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796601.090218:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936193792 00000100:00100000:0.0:1788796601.090228:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936193792 00000100:00100000:0.0:1788796601.090280:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 237 00000100:00100000:0.0:1788796601.090289:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:5599:x1875688936193792:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796601.090511:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:5599:x1875688936193792:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 223us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796601.090519:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 237 10000000:01000000:2.0:1788796601.307970:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788796601.307977:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd26717e800 from 7 10000000:01000000:2.0:1788796601.307983:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788796601.308026:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6200/0xdd273c88cfe22724 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796601.308040:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6200/0xdd273c88cfe22724 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796601.308053:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6200/0xdd273c88cfe22724 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796601.308080:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26130a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959298688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788796601.308175:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796601.308235:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2671edcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796601.308311:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959298688 00000100:00100000:1.0:1788796601.308320:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959298688 00000100:00100000:1.0:1788796601.308439:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788796601.308449:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959298688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796601.308462:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796601.308475:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd267334c00/0xdd273c88cfe2272b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe22724 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796601.308505:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd267334c00/0xdd273c88cfe2272b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe22724 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796601.308515:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd267334c00/0xdd273c88cfe2272b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22724 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796601.308524:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334c00, rc 0) 00000100:00100000:1.0:1788796601.308566:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959298688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796601.308573:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788796601.312337:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26130a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959298688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796601.312380:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6200/0xdd273c88cfe22724 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2272b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796601.312393:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6200/0xdd273c88cfe22724 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe2272b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796601.312471:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26130a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959298816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796601.312528:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796601.312575:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2671edcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796601.313163:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959298816 00000100:00100000:1.0:1788796601.313171:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959298816 00000100:00100000:1.0:1788796601.315918:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788796601.315944:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959298816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796601.316252:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959298816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (3723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796601.316260:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788796601.317063:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26130a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959298816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796601.317119:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26130a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959298944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796601.317169:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796601.317200:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2671edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796601.317214:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959298944 00000100:00100000:2.0:1788796601.317220:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959298944 00000100:00100000:2.0:1788796601.317253:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788796601.317260:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959298944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796601.318070:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959298944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 808us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796601.318078:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788796601.323111:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26130a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959298944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788796601.324093:0:11220:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788796601.324227:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788796601.324248:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788796601.324259:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6200/0xdd273c88cfe22724 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2272b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796601.324271:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6200/0xdd273c88cfe22724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2272b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796601.324281:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788796601.324283:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd2467d7000 from 7 10000000:01000000:1.0:1788796601.324296:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788796601.324329:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267334e00/0xdd273c88cfe22732 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796601.324349:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd267334e00/0xdd273c88cfe22732 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796601.324360:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd267334e00/0xdd273c88cfe22732 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796601.324383:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959299072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788796601.324445:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796601.324487:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd142700f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796601.324580:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959299072 00000100:00100000:3.0:1788796601.324587:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959299072 00000100:00100000:3.0:1788796601.324635:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788796601.324644:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959299072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796601.324658:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796601.324678:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe22739 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe22732 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796601.324700:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe22739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe22732 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796601.324717:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe22739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22732 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796601.324725:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20600, rc 0) 00000100:00100000:3.0:1788796601.325897:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959299072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1251us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796601.325906:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788796601.326163:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959299072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796601.326182:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd267334e00/0xdd273c88cfe22732 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22739 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796601.326191:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd267334e00/0xdd273c88cfe22732 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22739 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796601.326254:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959299200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796601.326285:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796601.326313:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd142700f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796601.326430:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959299200 00000100:00100000:3.0:1788796601.326445:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959299200 00000100:00100000:3.0:1788796601.326484:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788796601.326492:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959299200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796601.326735:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959299200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796601.326742:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788796601.327650:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d24a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959299200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796601.327685:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959299328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796601.327737:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796601.328150:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2466e1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788796601.328318:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959299328 00000100:00100000:1.0:1788796601.328324:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959299328 00000100:00100000:1.0:1788796601.328369:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788796601.328378:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd249a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959299328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796601.328534:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd249a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959299328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796601.328546:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788796601.328977:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959299328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788796601.330161:0:11221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788796601.338896:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788796601.338943:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788796601.338955:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267334e00/0xdd273c88cfe22732 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22739 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796601.338969:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd267334e00/0xdd273c88cfe22732 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22739 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796601.338981:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788796601.338984:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd250afa000 from 7 10000000:01000000:1.0:1788796601.338987:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788796601.339025:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267335000/0xdd273c88cfe22740 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796601.339035:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd267335000/0xdd273c88cfe22740 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796601.339046:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd267335000/0xdd273c88cfe22740 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796601.339070:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959299456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788796601.339136:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796601.339184:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd142700240 going to sleep for 11 seconds 00000100:00100000:2.0:1788796601.339236:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959299456 00000100:00100000:2.0:1788796601.339244:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959299456 00000100:00100000:2.0:1788796601.339290:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788796601.339308:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959299456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796601.339321:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796601.339331:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2466b7e00/0xdd273c88cfe22747 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe22740 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796601.339364:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2466b7e00/0xdd273c88cfe22747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe22740 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796601.339373:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2466b7e00/0xdd273c88cfe22747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22740 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796601.339381:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7e00, rc 0) 00000100:00100000:2.0:1788796601.339417:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959299456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796601.339424:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788796601.339622:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959299456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796601.339635:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd267335000/0xdd273c88cfe22740 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22747 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796601.339643:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd267335000/0xdd273c88cfe22740 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22747 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796601.339693:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959299584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796601.339726:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796601.340411:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd142700240 going to sleep for 11 seconds 00000100:00100000:3.0:1788796601.340571:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959299584 00000100:00100000:3.0:1788796601.340577:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959299584 00000100:00100000:3.0:1788796601.340615:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788796601.340622:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959299584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796601.341576:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959299584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 952us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796601.341586:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788796601.341861:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959299584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796601.341918:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a37800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959299712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796601.341967:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796601.341999:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48000 going to sleep for 11 seconds 00000100:00100000:3.0:1788796601.342447:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959299712 00000100:00100000:3.0:1788796601.342455:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959299712 00000100:00100000:3.0:1788796601.342498:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788796601.342507:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959299712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796601.342672:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959299712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796601.342688:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788796601.343550:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a37800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959299712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788796601.344329:0:11223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788796601.347861:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788796601.347900:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788796601.347923:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267335000/0xdd273c88cfe22740 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22747 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796601.347937:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd267335000/0xdd273c88cfe22740 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22747 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796601.689983:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796602.713873:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796603.226444:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959299968:0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.226516:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796603.226570:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959300480:0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.226595:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796603.226628:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788796603.226634:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959299840:0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.226661:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796603.226683:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959300352:0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.226703:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796603.226730:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959300096:0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.226771:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796603.226790:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788796603.226795:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959300224:0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.226815:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796603.226862:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959299968 00000100:00100000:1.0:1788796603.226870:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959299968 00000100:00100000:1.0:1788796603.226925:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959300352 00000100:00100000:1.0:1788796603.226928:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959300352 00000100:00100000:1.0:1788796603.226963:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959300096 00000100:00100000:1.0:1788796603.226966:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959300096 00000100:00100000:1.0:1788796603.226981:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788796603.226988:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959299968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.227038:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959299968:12345-0@lo:400:kworker.0 Request processed in 50us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796603.227045:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788796603.227059:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788796603.227066:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959300352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.227091:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959300352:12345-0@lo:400:kworker.0 Request processed in 26us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796603.227096:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788796603.227107:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788796603.227112:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959300096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.227140:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959300096:12345-0@lo:400:kworker.0 Request processed in 27us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796603.227145:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788796603.227163:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959300480 00000100:00100000:1.0:1788796603.227166:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959300480 00000100:00100000:1.0:1788796603.227190:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959300224 00000100:00100000:1.0:1788796603.227193:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959300224 00000100:00100000:1.0:1788796603.227207:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788796603.227212:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959300480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.227240:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959300480:12345-0@lo:400:kworker.0 Request processed in 28us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796603.227252:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788796603.227262:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788796603.227267:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959300224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.227297:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959300224:12345-0@lo:400:kworker.0 Request processed in 30us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796603.227302:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788796603.227319:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959299840 00000100:00100000:1.0:1788796603.227323:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959299840 00000100:00100000:1.0:1788796603.227348:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788796603.227354:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959299840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.227382:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959299840:12345-0@lo:400:kworker.0 Request processed in 28us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796603.227388:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:1.0:1788796603.227428:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788796603.227433:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788796603.227435:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788796603.227470:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd247d26d80 x1875688959300224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796603.227484:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959300224:0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.227493:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959300096:0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.227517:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959299840:0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.227525:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959300352:0@lo:400:kworker.0 00000100:00100000:1.0:1788796603.227532:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959299968:0@lo:400:kworker.0 00010000:00080000:1.0:1788796603.227551:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd247d26a00 x1875688959300480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796603.227559:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959300480:0@lo:400:kworker.0 00010000:00010000:0.0:1788796603.742197:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796603.742343:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959300608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796603.742411:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796603.742806:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959300608 00000100:00100000:0.0:1788796603.742831:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959300608 00000100:00100000:0.0:1788796603.742897:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788796603.742908:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959300608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788796603.742943:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788796603.743784:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959300608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 875us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796603.743792:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788796603.745158:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267a37480 x1875688959300608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796603.745187:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959300608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796603.790175:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796603.790209:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796603.790244:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796603.790274:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936194048 00000100:00100000:1.0:1788796603.790284:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936194048 00000100:00100000:1.0:1788796603.790337:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936194176 00000100:00100000:1.0:1788796603.790340:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936194176 00000100:00100000:1.0:1788796603.790362:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:1.0:1788796603.790374:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+6:2355:x1875688936194048:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796603.790454:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+6:2355:x1875688936194048:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 82us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796603.790460:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:1.0:1788796603.790475:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:1.0:1788796603.790481:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2355:x1875688936194176:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796603.790504:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2355:x1875688936194176:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 23us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796603.790519:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00080000:1.0:1788796603.790536:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796603.790692:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936193920 00000100:00100000:0.0:1788796603.790697:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936193920 00000100:00100000:0.0:1788796603.790734:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 248 00000100:00100000:0.0:1788796603.790742:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2355:x1875688936193920:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796603.790802:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2355:x1875688936193920:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 60us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796603.790808:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 248 00000001:02000400:0.0:1788796604.653372:0:11370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788796604.763525:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796605.274834:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959300736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796605.274924:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796605.275864:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959300736 00000100:00100000:0.0:1788796605.275877:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959300736 00000100:00100000:0.0:1788796605.275971:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788796605.275982:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959300736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796605.276019:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796605.276099:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959300736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796605.276106:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788796605.276186:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788796605.279871:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd247d25f80 x1875688959300736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796605.279914:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959300736:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788796605.786036:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796606.809977:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796607.833992:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796608.346923:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959301248:0@lo:400:kworker.0 00000100:00100000:1.0:1788796608.347082:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959300992:0@lo:400:kworker.0 00000100:00100000:2.0:1788796608.347154:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959301120:0@lo:400:kworker.0 00000100:00100000:0.0:1788796608.347327:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959300864:0@lo:400:kworker.0 00000100:00100000:1.0:1788796608.350317:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796608.350439:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959301504:0@lo:400:kworker.0 00000100:00100000:1.0:1788796608.350496:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796608.350571:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959300992 00000100:00100000:1.0:1788796608.350583:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959300992 00000100:00100000:2.0:1788796608.350803:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796608.350850:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959301120 00000100:00100000:2.0:1788796608.350854:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959301120 00000100:00100000:2.0:1788796608.350929:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788796608.350940:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959300992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796608.351159:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959300992:12345-0@lo:400:kworker.0 Request processed in 219us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796608.351241:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788796608.351263:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788796608.351271:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959301120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796608.351311:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959301120:12345-0@lo:400:kworker.0 Request processed in 42us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796608.351317:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788796608.351337:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796608.351387:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959301120:0@lo:400:kworker.0 00000100:00100000:2.0:1788796608.351421:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959300992:0@lo:400:kworker.0 00000100:00100000:2.0:1788796608.351559:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959301504 00000100:00100000:2.0:1788796608.351565:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959301504 00000100:00100000:2.0:1788796608.351607:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788796608.351614:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959301504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796608.351926:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796608.352734:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788796608.352768:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788796608.353578:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796608.353780:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959301504:12345-0@lo:400:kworker.0 Request processed in 2163us (3280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796608.353806:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788796608.353837:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959301248 00000100:00100000:2.0:1788796608.353848:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959301248 00000100:00100000:2.0:1788796608.353888:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788796608.353897:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959301248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796608.353954:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959301248:12345-0@lo:400:kworker.0 Request processed in 58us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796608.353980:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788796608.355803:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959301376:0@lo:400:kworker.0 00000100:00100000:0.0:1788796608.355907:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796608.355973:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959301376 00000100:00100000:0.0:1788796608.355984:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959301376 00000100:00100000:1.0:1788796608.356149:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959300864 00000100:00100000:1.0:1788796608.356156:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959300864 00000100:00100000:1.0:1788796608.356301:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788796608.356312:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959300864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796608.356409:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959300864:12345-0@lo:400:kworker.0 Request processed in 99us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796608.356416:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00080000:1.0:1788796608.356606:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd25037c700 x1875688959301248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796608.356625:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959301248:0@lo:400:kworker.0 00000100:00080000:2.0:1788796608.356885:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788796608.356892:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788796608.356924:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd25037ce00 x1875688959301504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796608.356935:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959301504:0@lo:400:kworker.0 00000100:00100000:0.0:1788796608.357436:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788796608.357446:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959301376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796608.357515:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959301376:12345-0@lo:400:kworker.0 Request processed in 70us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796608.357521:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788796608.357576:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959301376:0@lo:400:kworker.0 00000100:00100000:0.0:1788796608.357601:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959300864:0@lo:400:kworker.0 00000100:00080000:3.0:1788796608.358798:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796608.858221:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959301632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796608.858340:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788796608.859107:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796608.859291:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959301632 00000100:00100000:1.0:1788796608.859422:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959301632 00000100:00100000:1.0:1788796608.859523:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788796608.859534:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959301632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796608.859571:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788796608.864993:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959301632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5448us (6641us total) trans 0 rc 0/0 00010000:00080000:2.0:1788796608.865087:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267a34380 x1875688959301632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796624 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796608.865127:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959301632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796608.872848:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788796608.901549:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796608.901617:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796608.901650:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796608.901689:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936194304 00000100:00100000:3.0:1788796608.901702:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936194304 00000100:00100000:3.0:1788796608.901807:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 250 00000100:00100000:3.0:1788796608.901820:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2356:x1875688936194304:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796608.901913:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2356:x1875688936194304:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 95us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796608.901921:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 250 00000100:00100000:3.0:1788796608.901959:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936194432 00000100:00100000:3.0:1788796608.901963:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936194432 00000100:00100000:3.0:1788796608.902003:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936194560 00000100:00100000:3.0:1788796608.902006:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936194560 00000100:00100000:3.0:1788796608.902032:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00100000:3.0:1788796608.902039:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936194432:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796608.902075:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936194432:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 37us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796608.902081:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00100000:3.0:1788796608.902093:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 105 00000100:00100000:3.0:1788796608.902098:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936194560:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796608.902143:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936194560:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 44us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796608.902150:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 105 00000100:00080000:3.0:1788796608.902312:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788796609.086432:0:11471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 11:56:48 (1788796608) === 00000100:00100000:3.0:1788796609.345826:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796609.346572:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796609.346605:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936194688 00000100:00100000:3.0:1788796609.346621:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936194688 00000100:00100000:3.0:1788796609.346678:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:3.0:1788796609.346690:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2358:x1875688936194688:12345-192.168.201.25@tcp:41:mkdir.0 00000004:00000024:3.0:1788796609.346738:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788796609.346858:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2358:x1875688936194688:12345-192.168.201.25@tcp:41:mkdir.0 Request processed in 171us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796609.346865:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:0.0:1788796609.353559:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936194816 00000100:00100000:0.0:1788796609.353585:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936194816 00000100:00100000:0.0:1788796609.353686:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:0.0:1788796609.353698:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ad2796a3-2145-47da-88fb-baa43721bec1+6:9670:x1875688936194816:12345-192.168.201.25@tcp:700:mkdir.0 00000100:00100000:0.0:1788796609.353865:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ad2796a3-2145-47da-88fb-baa43721bec1+6:9670:x1875688936194816:12345-192.168.201.25@tcp:700:mkdir.0 Request processed in 168us (8047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796609.353874:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:3.0:1788796609.357816:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796609.357864:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936195072 00000100:00100000:3.0:1788796609.357892:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936195072 00000100:00100000:3.0:1788796609.357966:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:3.0:1788796609.357978:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:9670:x1875688936195072:12345-192.168.201.25@tcp:36:mkdir.0 00010000:00010000:3.0:1788796609.358058:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796609.365704:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe2262f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e813 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.365733:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d573900) 00010000:00010000:3.0:1788796609.365978:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788796609.366352:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2274e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.366373:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2274e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.366385:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2274e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.366417:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22755 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.366425:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.366431:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796609.369478:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788796609.369500:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2274e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.369511:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2274e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.369519:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2274e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.369525:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796609.369530:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2274e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.369538:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2274e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.369568:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712b300) 00010000:00010000:3.0:1788796609.369571:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796609.369576:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2274e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.369583:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2274e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788796609.369606:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d598e67 reply state 00000000e36c899a transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796609.369616:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788796609.369738:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+7:9670:x1875688936195072:12345-192.168.201.25@tcp:36:mkdir.0 Request processed in 11757us (11933us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788796609.370218:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00010000:00010000:2.0:1788796609.375872:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796609.376338:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22755 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796609.376347:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22755 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796609.377038:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796609.377045:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22755 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796609.377058:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22755 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796609.377085:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bd24712bf00) 00010000:00010000:2.0:1788796609.377104:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796609.377119:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22755 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796609.377127:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22755 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796609.397729:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796609.400823:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936195200 00000100:00100000:0.0:1788796609.400849:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936195200 00000100:00100000:0.0:1788796609.400960:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:0.0:1788796609.400981:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:9675:x1875688936195200:12345-192.168.201.25@tcp:101:chmod.0 00010000:00010000:0.0:1788796609.401039:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796609.401084:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031e00/0xdd273c88cfe2275c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e898 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.401188:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe22763 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.401207:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe22763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.401224:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe22763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796609.401272:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788796609.401276:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788796609.401326:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe22763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.401867:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031e00/0xdd273c88cfe2275c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e898 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.401997:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe22763 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e898 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.402008:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1400) 00010000:00010000:0.0:1788796609.402011:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788796609.402016:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240031600, rc 0) 00000100:00100000:0.0:1788796609.402176:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:9675:x1875688936195200:12345-192.168.201.25@tcp:101:chmod.0 Request processed in 1202us (4455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796609.402187:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:3.0:1788796609.415597:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796609.415803:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936195456 00000100:00100000:0.0:1788796609.415813:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936195456 00000100:00100000:0.0:1788796609.415876:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:0.0:1788796609.415886:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:9675:x1875688936195456:12345-192.168.201.25@tcp:36:chmod.0 00010000:00010000:1.0:1788796609.421601:0:10139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796609.421664:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe22763 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e898 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.421696:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1400) 00010000:00010000:1.0:1788796609.421712:0:10139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796609.421918:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334a00/0xdd273c88cfe2276a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.421937:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334a00/0xdd273c88cfe2276a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.421949:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334a00/0xdd273c88cfe2276a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788796609.425349:0:10139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089ac11ca reply state 000000004b75fa9d transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334a00/0xdd273c88cfe2276a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796609.428401:0:10139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788796609.428439:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788796609.430089:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+8:9675:x1875688936195456:12345-192.168.201.25@tcp:36:chmod.0 Request processed in 14186us (14484us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788796609.430105:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00010000:00010000:1.0:1788796609.439005:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334a00/0xdd273c88cfe2276a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.439032:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334a00/0xdd273c88cfe2276a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.439061:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334a00/0xdd273c88cfe2276a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.439068:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796609.439074:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334a00/0xdd273c88cfe2276a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.439083:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334a00/0xdd273c88cfe2276a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.439105:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd255d57a00) 00010000:00010000:1.0:1788796609.439108:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788796609.439113:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334a00/0xdd273c88cfe2276a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.439120:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334a00/0xdd273c88cfe2276a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796609.485628:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796609.485813:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936195584 00000100:00100000:0.0:1788796609.485825:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936195584 00000100:00100000:0.0:1788796609.485888:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:0.0:1788796609.485898:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+7:9677:x1875688936195584:12345-192.168.201.25@tcp:101:chown.0 00010000:00010000:0.0:1788796609.485924:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796609.485947:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031e00/0xdd273c88cfe22771 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e89f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.486024:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe22778 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.486038:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe22778 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.486051:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe22778 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796609.486092:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788796609.486096:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788796609.486139:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe22778 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.486168:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031e00/0xdd273c88cfe22771 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e89f expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.486192:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe22778 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e89f expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.486233:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1d00) 00010000:00010000:0.0:1788796609.486237:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788796609.486241:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240031600, rc 0) 00000100:00100000:0.0:1788796609.486315:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+8:9677:x1875688936195584:12345-192.168.201.25@tcp:101:chown.0 Request processed in 417us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796609.486322:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:3.0:1788796609.490374:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796609.490518:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936195712 00000100:00100000:0.0:1788796609.490529:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936195712 00000100:00100000:0.0:1788796609.490593:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:0.0:1788796609.490602:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+8:9677:x1875688936195712:12345-192.168.201.25@tcp:101:chown.0 00010000:00010000:0.0:1788796609.490631:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796609.490651:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030200/0xdd273c88cfe2277f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e8a6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.490723:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031800/0xdd273c88cfe22786 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.490737:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031800/0xdd273c88cfe22786 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.490794:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031800/0xdd273c88cfe22786 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.490810:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe2278d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.490817:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe2278d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.490842:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe2278d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.490958:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe22794 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.490968:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe22794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.490975:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe22794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796609.491006:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788796609.491010:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788796609.491029:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe22794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491041:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031800/0xdd273c88cfe22786 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491048:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031800/0xdd273c88cfe22786 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491054:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031800/0xdd273c88cfe22786 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491060:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796609.491064:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031800/0xdd273c88cfe22786 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491071:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031800/0xdd273c88cfe22786 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491092:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1d00) 00010000:00010000:0.0:1788796609.491095:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796609.491101:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031800/0xdd273c88cfe22786 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491107:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031800/0xdd273c88cfe22786 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491122:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe2278d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491127:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe2278d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491132:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe2278d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491137:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796609.491140:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe2278d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491145:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe2278d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491152:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bd24d5f1b00) 00010000:00010000:0.0:1788796609.491154:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796609.491156:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe2278d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491162:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe2278d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491204:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030200/0xdd273c88cfe2277f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8a6 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491231:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe22794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8a6 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.491239:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd24d5f1400) 00010000:00010000:0.0:1788796609.491242:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788796609.491245:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5600, rc 0) 00000100:00100000:0.0:1788796609.491305:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+9:9677:x1875688936195712:12345-192.168.201.25@tcp:101:chown.0 Request processed in 703us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796609.491312:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:2.0:1788796609.496537:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796609.496624:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936195968 00000100:00100000:0.0:1788796609.496635:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936195968 00000100:00100000:0.0:1788796609.496700:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:0.0:1788796609.496711:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+9:9677:x1875688936195968:12345-192.168.201.25@tcp:36:chown.0 00010000:00010000:0.0:1788796609.497191:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796609.497289:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe22794 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8a6 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.497310:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd24d5f1400) 00010000:00010000:0.0:1788796609.497321:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788796609.497346:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe2279b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.497358:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe2279b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.497377:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe2279b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788796609.549979:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1788796609.550089:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e9bf321 reply state 000000003e20ec44 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe2279b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796609.550104:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788796609.550118:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1788796609.550224:0:5846:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788796609.550244:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+7:9677:x1875688936195968:12345-192.168.201.25@tcp:36:chown.0 Request processed in 53531us (53712us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788796609.550253:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00010000:00010000:3.0:1788796609.550289:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe2279b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.550312:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe2279b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.550319:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe2279b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.550326:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796609.550330:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe2279b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.550339:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe2279b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.550354:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd24d5f1300) 00010000:00010000:3.0:1788796609.550357:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788796609.550362:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe2279b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.550369:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe2279b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796609.565938:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796609.566195:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936196096 00000100:00100000:3.0:1788796609.566205:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936196096 00000100:00100000:3.0:1788796609.566314:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:3.0:1788796609.566325:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:9678:x1875688936196096:12345-192.168.201.25@tcp:101:touch.500 00010000:00010000:3.0:1788796609.566351:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796609.566387:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe227a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e8ad expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788796609.573333:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6890us 00010000:00010000:1.0:1788796609.619181:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334000/0xdd273c88cfe227a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619205:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334000/0xdd273c88cfe227a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619218:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334000/0xdd273c88cfe227a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619233:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe227b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619241:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe227b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619256:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe227b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619590:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe227b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619598:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe227b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619606:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe227b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796609.619626:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788796609.619630:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796609.619663:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe227b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619674:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334000/0xdd273c88cfe227a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619680:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334000/0xdd273c88cfe227a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619687:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334000/0xdd273c88cfe227a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619693:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796609.619697:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334000/0xdd273c88cfe227a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619705:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334000/0xdd273c88cfe227a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619724:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1d00) 00010000:00010000:1.0:1788796609.619727:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796609.619732:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334000/0xdd273c88cfe227a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619738:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334000/0xdd273c88cfe227a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619777:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe227b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619784:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe227b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619790:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe227b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619794:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796609.619797:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe227b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619803:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe227b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619810:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bd255d57a00) 00010000:00010000:1.0:1788796609.619812:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796609.619815:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe227b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619829:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe227b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619876:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe227a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8ad expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619893:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe227b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8ad expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.619900:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796609.619902:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788796609.619905:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334400, rc 0) 00000100:00100000:1.0:1788796609.620233:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+7:9678:x1875688936196096:12345-192.168.201.25@tcp:101:touch.500 Request processed in 53908us (54304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796609.620243:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:0.0:1788796609.628301:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796609.628920:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936196352 00000100:00100000:3.0:1788796609.628947:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936196352 00000100:00100000:3.0:1788796609.629028:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:3.0:1788796609.629040:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:9678:x1875688936196352:12345-192.168.201.25@tcp:101:touch.500 00010000:00010000:3.0:1788796609.629066:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796609.629091:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe227be lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e8b4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.629359:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21e00/0xdd273c88cfe227c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.629374:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21e00/0xdd273c88cfe227c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.629386:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21e00/0xdd273c88cfe227c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.629401:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe227cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.629409:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe227cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.629416:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe227cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788796609.631569:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788796609.632399:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe227d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.632416:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe227d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.632441:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe227d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.632481:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21e00/0xdd273c88cfe227c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.632489:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21e00/0xdd273c88cfe227c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.632495:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21e00/0xdd273c88cfe227c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.632502:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796609.632506:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21e00/0xdd273c88cfe227c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.632514:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21e00/0xdd273c88cfe227c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.632525:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:3.0:1788796609.632528:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796609.632534:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21e00/0xdd273c88cfe227c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.632541:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21e00/0xdd273c88cfe227c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788796609.632555:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044886fbd reply state 00000000b67a93d9 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe227cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796609.632564:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788796609.632606:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe227be lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8b4 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.633390:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe227d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8b4 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.633398:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:3.0:1788796609.633401:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788796609.633404:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21800, rc 0) 00000100:00100000:3.0:1788796609.633586:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+10:9678:x1875688936196352:12345-192.168.201.25@tcp:101:touch.500 Request processed in 4546us (5296us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788796609.633596:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00010000:00010000:3.0:1788796609.643353:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe227cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.643557:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe227cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.643567:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe227cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.643574:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796609.643579:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe227cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.643587:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe227cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.643604:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4cf2bfa5 (ffff9bd24712b300) 00010000:00010000:3.0:1788796609.643667:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796609.643686:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe227cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.643693:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe227cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796609.644975:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796609.645436:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936196608 00000100:00100000:3.0:1788796609.645446:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936196608 00000100:00100000:3.0:1788796609.645506:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:3.0:1788796609.645515:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+9:9678:x1875688936196608:12345-192.168.201.25@tcp:36:touch.500 00010000:00010000:3.0:1788796609.645576:0:10139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796609.645601:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe227d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8b4 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.645632:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:3.0:1788796609.645642:0:10139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788796609.645684:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe227e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.645697:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe227e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.645707:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe227e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788796609.645908:0:10139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef0fcde8 reply state 000000003b86a86e transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe227e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796609.645917:0:10139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788796609.646020:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+10:9678:x1875688936196608:12345-192.168.201.25@tcp:36:touch.500 Request processed in 505us (1059us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788796609.646046:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:0.0:1788796609.651716:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796609.652830:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936196736 00000100:00100000:1.0:1788796609.652841:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936196736 00000100:00100000:1.0:1788796609.652902:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:1.0:1788796609.652913:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+10:9678:x1875688936196736:12345-192.168.201.25@tcp:101:touch.500 00010000:00010000:1.0:1788796609.652941:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796609.652972:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe227e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e8bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.653036:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe227e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8bb expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.653051:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe227e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8bb expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.653092:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd24712bb00) 00010000:00010000:1.0:1788796609.653096:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788796609.653099:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334600, rc 0) 00000100:00100000:1.0:1788796609.653167:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+11:9678:x1875688936196736:12345-192.168.201.25@tcp:101:touch.500 Request processed in 256us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796609.653175:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00010000:00010000:3.0:1788796609.655447:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe227e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.655465:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe227e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.655473:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe227e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.655479:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796609.655484:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe227e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.655493:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe227e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.655512:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd24712bb00) 00010000:00010000:3.0:1788796609.655516:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796609.655521:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe227e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.655526:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe227e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796609.657685:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796609.660212:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936196864 00000100:00100000:0.0:1788796609.660228:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936196864 00000100:00100000:0.0:1788796609.660317:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:0.0:1788796609.660325:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875688936196864:12345-192.168.201.25@tcp:8:touch.500 00010000:00080000:0.0:1788796609.660358:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:0.0:1788796609.660388:0:6692:0:(genops.c:1384:class_connect()) connect: client ad2796a3-2145-47da-88fb-baa43721bec1, cookie 0xdd273c88cfe227ef 00002000:00100000:0.0:1788796609.660400:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ad2796a3-2145-47da-88fb-baa43721bec1/ffff9bd2672f8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788796609.660424:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788796609.660677:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788796609.660713:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9bd2672fa000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788796609.660834:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2354:x1875688936196864:12345-192.168.201.25@tcp:8:touch.500 Request processed in 507us (3156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796609.660841:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788796609.663397:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796609.663602:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936196992 00000100:00100000:2.0:1788796609.663622:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936196992 00000100:00100000:0.0:1788796609.663832:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:0.0:1788796609.663844:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:0:x1875688936196992:12345-192.168.201.25@tcp:2:touch.500 00000100:00080000:1.0:1788796609.664819:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788796609.727442:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1788796609.727468:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad2796a3-2145-47da-88fb-baa43721bec1 00000100:00100000:0.0:1788796609.732096:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+5:0:x1875688936196992:12345-192.168.201.25@tcp:2:touch.500 Request processed in 68241us (68693us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788796609.732129:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:1.0:1788796609.735164:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796609.735572:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936197248 00000100:00100000:0.0:1788796609.735583:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936197248 00000100:00100000:0.0:1788796609.735650:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:0.0:1788796609.735660:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+10:9678:x1875688936197248:12345-192.168.201.25@tcp:35:touch.500 00000100:00100000:0.0:1788796609.736087:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+11:9678:x1875688936197248:12345-192.168.201.25@tcp:35:touch.500 Request processed in 426us (930us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788796609.736095:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:3.0:1788796609.753334:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796609.754496:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936197376 00000100:00100000:1.0:1788796609.754509:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936197376 00000100:00100000:1.0:1788796609.754575:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:1.0:1788796609.754586:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+11:9679:x1875688936197376:12345-192.168.201.25@tcp:101:rm.0 00010000:00010000:1.0:1788796609.755065:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796609.755089:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe227f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e8c2 expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.755160:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe227fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.755174:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe227fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.755187:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe227fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796609.755224:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788796609.755241:0:10139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796609.755287:0:10139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe227fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.755315:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe227f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8c2 expref: 13 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.755334:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe227fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8c2 expref: 12 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.755343:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796609.755346:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788796609.755350:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335c00, rc 0) 00000100:00100000:1.0:1788796609.755587:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+12:9679:x1875688936197376:12345-192.168.201.25@tcp:101:rm.0 Request processed in 1002us (2264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796609.755594:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:2.0:1788796609.762453:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796609.762816:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936197632 00000100:00100000:3.0:1788796609.762840:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936197632 00000100:00100000:3.0:1788796609.762896:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:3.0:1788796609.762907:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+12:9679:x1875688936197632:12345-192.168.201.25@tcp:101:rm.0 00010000:00010000:3.0:1788796609.762928:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796609.762949:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe22804 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e8c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796609.763050:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788796609.763205:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe22804 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8c9 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.763220:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1d00) 00010000:00010000:3.0:1788796609.763223:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788796609.763228:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe22804 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8c9 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.763242:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21a00, rc 0) 00000100:00100000:3.0:1788796609.763305:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+13:9679:x1875688936197632:12345-192.168.201.25@tcp:101:rm.0 Request processed in 399us (861us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788796609.763312:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:2.0:1788796609.767854:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796609.768052:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936197760 00000100:00100000:3.0:1788796609.768062:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936197760 00000100:00100000:3.0:1788796609.768105:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:3.0:1788796609.768114:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+13:9679:x1875688936197760:12345-192.168.201.25@tcp:37:rm.0 00000100:00100000:3.0:1788796609.774570:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+13:9679:x1875688936197760:12345-192.168.201.25@tcp:37:rm.0 Request processed in 6445us (6714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796609.774583:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:2.0:1788796609.778699:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796609.778828:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936198016 00000100:00100000:3.0:1788796609.778838:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936198016 00000100:00100000:3.0:1788796609.778899:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:3.0:1788796609.778908:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2725d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+13:9679:x1875688936198016:12345-192.168.201.25@tcp:35:rm.0 00000100:00100000:3.0:1788796609.779155:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2725d2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+14:9679:x1875688936198016:12345-192.168.201.25@tcp:35:rm.0 Request processed in 248us (465us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788796609.779162:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:2.0:1788796609.785057:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796609.785301:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936198272 00000100:00100000:0.0:1788796609.785312:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936198272 00000100:00100000:0.0:1788796609.785381:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:0.0:1788796609.785391:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+14:9679:x1875688936198272:12345-192.168.201.25@tcp:101:rm.0 00010000:00010000:0.0:1788796609.785417:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796609.785439:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22812 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e8d0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.785540:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22819 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.785554:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22819 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.785565:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22819 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796609.785576:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788796609.785723:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22812 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8d0 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.785805:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22819 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8d0 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.785814:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:0.0:1788796609.785817:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788796609.785821:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5200, rc 0) 00000100:00100000:0.0:1788796609.785872:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+16:9679:x1875688936198272:12345-192.168.201.25@tcp:101:rm.0 Request processed in 481us (825us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788796609.785879:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:1.0:1788796609.789918:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796609.790238:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936198400 00000100:00100000:3.0:1788796609.790250:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936198400 00000100:00100000:3.0:1788796609.790311:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:3.0:1788796609.790322:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+16:9679:x1875688936198400:12345-192.168.201.25@tcp:41:rm.0 00000004:00000024:3.0:1788796609.790385:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7718567936 avail 7714373632 00000100:00100000:3.0:1788796609.790468:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+16:9679:x1875688936198400:12345-192.168.201.25@tcp:41:rm.0 Request processed in 140us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796609.790476:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:2.0:1788796609.793470:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796609.793559:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936198528 00000100:00100000:0.0:1788796609.793570:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936198528 00000100:00100000:0.0:1788796609.793639:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:0.0:1788796609.793650:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+16:9679:x1875688936198528:12345-192.168.201.25@tcp:101:rm.0 00010000:00010000:0.0:1788796609.793682:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796609.793705:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22827 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e8d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.793831:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe2282e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.793847:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe2282e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.793859:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe2282e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.793873:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22835 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.793887:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.793895:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794007:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5400/0xdd273c88cfe2283c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794015:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5400/0xdd273c88cfe2283c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794022:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5400/0xdd273c88cfe2283c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796609.794048:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788796609.794053:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788796609.794070:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5400/0xdd273c88cfe2283c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794081:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5400/0xdd273c88cfe2283c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794088:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe2282e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794095:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe2282e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794100:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe2282e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794116:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796609.794121:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe2282e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794129:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe2282e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794142:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:0.0:1788796609.794145:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796609.794150:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe2282e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794156:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe2282e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794171:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794177:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22835 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794183:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794188:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796609.794191:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794198:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794215:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4cf2bfa5 (ffff9bd24d5f1b00) 00010000:00010000:0.0:1788796609.794218:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796609.794221:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22835 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794226:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22835 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794259:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22827 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8d7 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794274:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5400/0xdd273c88cfe2283c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8d7 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.794282:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd24712bb00) 00010000:00010000:0.0:1788796609.794285:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788796609.794287:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5400, rc 0) 00000100:00100000:0.0:1788796609.794346:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+17:9679:x1875688936198528:12345-192.168.201.25@tcp:101:rm.0 Request processed in 698us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796609.794353:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:2.0:1788796609.805306:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796609.805383:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936198784 00000100:00100000:3.0:1788796609.805394:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936198784 00000100:00100000:3.0:1788796609.805466:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:3.0:1788796609.805477:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+17:9679:x1875688936198784:12345-192.168.201.25@tcp:36:rm.0 00010000:00010000:3.0:1788796609.805532:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788796609.805557:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5400/0xdd273c88cfe2283c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8d7 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.805581:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe227e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8bb expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.805625:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd24712bb00) 00010000:00010000:3.0:1788796609.805645:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe227fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8c2 expref: 15 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.805655:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:3.0:1788796609.805659:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788796609.805691:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe22843 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.805705:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe22843 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.805715:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe22843 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.805731:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe2284a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.805739:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe2284a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.805797:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe2284a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.805903:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22851 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.805912:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22851 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.805929:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22851 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788796609.806638:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788796609.806650:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336787903638ns, next at 337787900729ns, rc = 0 00010000:00010000:3.0:1788796609.806714:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22858 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806725:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22858 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806734:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22858 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806743:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22858 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806790:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22858 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806796:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22858 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806816:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788796609.806835:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22851 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806841:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22851 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806848:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22851 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806861:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796609.806866:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22851 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806874:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22851 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806885:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd24712b300) 00010000:00010000:3.0:1788796609.806888:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788796609.806893:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22851 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806899:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe22851 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806918:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe22843 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806924:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe22843 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806931:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe22843 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806935:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796609.806938:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe22843 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806944:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe22843 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806963:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:3.0:1788796609.806965:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796609.806969:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe22843 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.806975:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe22843 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788796609.806986:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f53a38bb reply state 00000000a3c5a21c transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe2284a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796609.806996:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788796609.807924:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796609.807935:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22858 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.807942:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21200 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:1.0:1788796609.807946:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22858 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.807953:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22858 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.807964:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bd24712b300) 00010000:00010000:1.0:1788796609.807967:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788796609.807981:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22858 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.807987:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22858 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.808005:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796609.808007:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796609.808009:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796609.808208:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+16:9679:x1875688936198784:12345-192.168.201.25@tcp:36:rm.0 Request processed in 2728us (2907us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788796609.808217:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:2.0:1788796609.822007:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:3.0:1788796609.822187:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe2284a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.822200:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe2284a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.822218:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe2284a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.822226:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796609.822230:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe2284a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.822238:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe2284a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.822269:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4cf2bfa5 (ffff9bd24712b900) 00010000:00010000:3.0:1788796609.822272:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796609.822277:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe2284a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.822284:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21800/0xdd273c88cfe2284a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796609.823739:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936199040 00000100:00100000:0.0:1788796609.823831:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936199040 00000100:00100000:0.0:1788796609.823931:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:0.0:1788796609.823943:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+15:9679:x1875688936199040:12345-192.168.201.25@tcp:35:rm.0 00000100:00100000:0.0:1788796609.824225:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+16:9679:x1875688936199040:12345-192.168.201.25@tcp:35:rm.0 Request processed in 283us (2318us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788796609.824233:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1788796609.827838:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796609.827909:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936199296 00000100:00100000:1.0:1788796609.827919:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936199296 00000100:00100000:1.0:1788796609.827981:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:1.0:1788796609.827990:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+16:9679:x1875688936199296:12345-192.168.201.25@tcp:36:rm.0 00010000:00010000:1.0:1788796609.828049:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788796609.828074:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22819 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8d0 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.828095:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe227b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8ad expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.828106:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796609.828119:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe22778 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e89f expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.828128:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1d00) 00010000:00010000:1.0:1788796609.828134:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796609.828155:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe2285f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.828167:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe2285f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.828190:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe2285f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.828212:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22866 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.828220:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22866 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.828226:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22866 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.828442:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2286d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.828451:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2286d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.828466:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2286d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796609.829023:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788796609.829041:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2286d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.829048:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2286d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.829054:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2286d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.829059:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796609.829070:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2286d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.829077:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2286d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.829087:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bd255d57700) 00010000:00010000:1.0:1788796609.829090:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788796609.829094:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2286d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.829100:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2286d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.829118:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe2285f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.829124:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe2285f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.829130:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe2285f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.829134:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796609.829137:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe2285f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.829142:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe2285f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.829149:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd255d57a00) 00010000:00010000:1.0:1788796609.829151:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796609.829160:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe2285f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796609.829166:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe2285f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788796609.829179:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8f0ed08 reply state 000000005832a445 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22866 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796609.829187:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788796609.829269:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+15:9679:x1875688936199296:12345-192.168.201.25@tcp:36:rm.0 Request processed in 1278us (1436us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788796609.829278:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 31 00010000:00010000:3.0:1788796609.834736:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22866 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.834803:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22866 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.834812:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22866 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.834819:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796609.834823:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22866 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.834832:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22866 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.834849:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bd255d57900) 00010000:00010000:3.0:1788796609.834854:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796609.834859:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22866 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796609.834866:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22866 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796609.882666:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796610.395562:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959301760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796610.395652:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796610.395968:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959301760 00000100:00100000:0.0:1788796610.395977:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959301760 00000100:00100000:0.0:1788796610.396049:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788796610.396059:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959301760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796610.396081:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796610.396131:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959301760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796610.396138:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788796610.396182:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd247d27100 x1875688959301760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796626 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796610.396203:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959301760:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788796610.396383:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788796610.914034:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796611.930064:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796612.955547:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796613.466158:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd24121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959301888:0@lo:400:kworker.0 00000100:00100000:0.0:1788796613.466238:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796613.466309:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd24121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959302400:0@lo:400:kworker.0 00000100:00100000:0.0:1788796613.466338:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796613.466367:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788796613.466373:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd241218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959302016:0@lo:400:kworker.0 00000100:00100000:0.0:1788796613.466395:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796613.466411:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd241218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959302528:0@lo:400:kworker.0 00000100:00100000:0.0:1788796613.466434:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796613.466461:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd241219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959302272:0@lo:400:kworker.0 00000100:00100000:0.0:1788796613.466485:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796613.466502:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788796613.466522:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd241219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959302144:0@lo:400:kworker.0 00000100:00100000:2.0:1788796613.466635:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959301888 00000100:00100000:2.0:1788796613.466644:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959301888 00000100:00100000:2.0:1788796613.466692:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788796613.466711:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959301888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796613.466794:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959301888:12345-0@lo:400:kworker.0 Request processed in 94us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796613.466802:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788796613.466844:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959302528 00000100:00100000:2.0:1788796613.466848:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959302528 00000100:00100000:2.0:1788796613.466883:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959302272 00000100:00100000:2.0:1788796613.466887:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959302272 00000100:00100000:2.0:1788796613.466908:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788796613.466915:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959302528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796613.466948:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959302528:12345-0@lo:400:kworker.0 Request processed in 33us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796613.466954:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788796613.466966:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788796613.466972:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959302272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796613.466998:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959302272:12345-0@lo:400:kworker.0 Request processed in 27us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796613.467004:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788796613.467022:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788796613.467026:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788796613.467057:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959302400 00000100:00100000:2.0:1788796613.467061:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959302400 00000100:00100000:2.0:1788796613.467087:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959302016 00000100:00100000:2.0:1788796613.467090:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959302016 00000100:00100000:2.0:1788796613.467107:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788796613.467113:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959302400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796613.467141:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959302400:12345-0@lo:400:kworker.0 Request processed in 28us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796613.467146:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788796613.467156:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788796613.467161:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959302016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796613.467182:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959302016:12345-0@lo:400:kworker.0 Request processed in 21us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796613.467194:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1788796613.467212:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796613.467246:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd241218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959302016:0@lo:400:kworker.0 00010000:00080000:2.0:1788796613.467260:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd241218000 x1875688959302528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796613.467270:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd241218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959302528:0@lo:400:kworker.0 00000100:00100000:2.0:1788796613.467279:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd24121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959301888:0@lo:400:kworker.0 00000100:00100000:2.0:1788796613.467287:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd24121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959302400:0@lo:400:kworker.0 00000100:00100000:0.0:1788796613.467483:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788796613.467521:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd241219f80 x1875688959302272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796613.467531:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd241219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959302272:0@lo:400:kworker.0 00000100:00100000:3.0:1788796613.467735:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959302144 00000100:00100000:3.0:1788796613.467740:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959302144 00000100:00100000:3.0:1788796613.467802:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788796613.467809:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959302144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796613.467853:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959302144:12345-0@lo:400:kworker.0 Request processed in 45us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796613.467859:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1788796613.470584:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796613.470647:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd241219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959302144:0@lo:400:kworker.0 00010000:00010000:0.0:1788796613.977905:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796613.978141:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788796613.978165:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959302656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796613.978237:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796613.980834:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959302656 00000100:00100000:0.0:1788796613.980850:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959302656 00000100:00100000:0.0:1788796613.980924:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788796613.980936:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959302656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788796613.980975:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788796613.981052:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959302656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (2815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796613.981059:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1788796613.981150:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267a37480 x1875688959302656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796629 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796613.981172:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959302656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796614.038769:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796614.038813:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796614.038855:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796614.038884:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796614.038914:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936199552 00000100:00100000:2.0:1788796614.038923:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936199552 00000100:00100000:2.0:1788796614.038977:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936199808 00000100:00100000:2.0:1788796614.038981:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936199808 00000100:00100000:2.0:1788796614.039002:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 109 00000100:00100000:2.0:1788796614.039011:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+14:2358:x1875688936199552:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796614.039095:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+14:2358:x1875688936199552:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796614.039104:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 109 00000100:00100000:2.0:1788796614.039122:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 110 00000100:00100000:2.0:1788796614.039128:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2358:x1875688936199808:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796614.039154:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2358:x1875688936199808:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 26us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796614.039160:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 110 00000100:00080000:2.0:1788796614.039179:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796614.043161:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936199680 00000100:00100000:1.0:1788796614.043180:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936199680 00000100:00100000:1.0:1788796614.043274:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:1.0:1788796614.043289:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24121b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2358:x1875688936199680:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796614.043371:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24121b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2358:x1875688936199680:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 87us (4557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796614.043379:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00080000:2.0:1788796614.044006:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796614.044209:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936199424 00000100:00100000:3.0:1788796614.044215:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936199424 00000100:00100000:3.0:1788796614.044319:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 252 00000100:00100000:3.0:1788796614.044328:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936199424:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796614.044368:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936199424:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 41us (5638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796614.044374:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 252 00000001:02000400:3.0:1788796614.622987:0:11624:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788796615.002983:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788796615.106539:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:2.0:1788796615.106562:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788796615.106572:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788796615.107044:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788796615.107066:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959302784:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788796615.107144:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796615.107339:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959302784 00000100:00100000:2.0:1788796615.107348:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959302784 00000100:00100000:2.0:1788796615.107404:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788796615.107413:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959302784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788796615.107442:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788796615.107477:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9edec2, atime: 0x6a9edec2, ctime: 0x6a9edec2, blocks: 0x1 00010000:00010000:2.0:1788796615.107486:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e60342c0/0xdd273c88cfe22874 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.107503:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1788796615.107508:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796615.107717:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e60342c0/0xdd273c88cfe22874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.107800:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e60342c0/0xdd273c88cfe22874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.107812:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e60342c0/0xdd273c88cfe22874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.107821:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e60342c0/0xdd273c88cfe22874 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.107837:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788796615.108420:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875688959302784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1006us (1273us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788796615.108430:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788796615.108458:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788796615.108496:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd247d27100/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788796615.108502:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959302784:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788796615.109257:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796615.109267:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e60342c0/0xdd273c88cfe22874 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796615.109279:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7000 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796615.109284:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e60342c0/0xdd273c88cfe22874 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796615.109295:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e60342c0/0xdd273c88cfe22874 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796615.109334:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e60342c0/0xdd273c88cfe22874 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796615.109341:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e60342c0/0xdd273c88cfe22874 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796615.109365:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796615.109367:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796615.109368:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796615.514030:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788796615.514055:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959302912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788796615.514127:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796615.514189:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959302912 00000100:00100000:1.0:1788796615.514203:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959302912 00000100:00100000:1.0:1788796615.514255:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788796615.514266:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875688959302912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796615.514311:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796615.514362:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875688959302912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796615.514370:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788796615.514433:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959302912:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1788796615.745402:0:11675:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6324ab40 20000000:00000080:2.0:1788796615.745419:0:11675:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd27eaf9400 uarg=0000000000000000 20000000:01000000:2.0:1788796615.745454:0:11675:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788796615.745465:0:11675:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788796615.745471:0:11675:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788796615.746684:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788796615.747180:0:11675:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788796615.755248:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788796615.755379:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788796615.755439:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788796615.755456:0:11675:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788796615.755476:0:11675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe2287b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796615.755494:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd247d21c00/0xdd273c88cfe22716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e88a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796615.755566:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd247d20800/0xdd273c88cfe2271d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e891 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796615.755575:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd267334c00/0xdd273c88cfe2272b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22724 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796615.755581:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe22739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22732 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796615.755587:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd2466b7e00/0xdd273c88cfe22747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22740 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796615.755603:0:11675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe2287b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796615.755640:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd2466b7e00/0xdd273c88cfe22747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe22740 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796615.755655:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd2466b7e00/0xdd273c88cfe22747 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe22740 expref: 18 pid: 5837 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796615.755680:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875688959303040:0@lo:104: 00000100:00100000:1.0:1788796615.755742:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796615.757129:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe22739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe22732 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796615.757145:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe22739 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe22732 expref: 18 pid: 5839 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796615.757157:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261297b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875688959303168:0@lo:104: 00000100:00100000:1.0:1788796615.757196:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796615.758273:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd267334c00/0xdd273c88cfe2272b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe22724 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796615.758301:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd267334c00/0xdd273c88cfe2272b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe22724 expref: 18 pid: 5839 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796615.758312:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261297800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875688959303296:0@lo:104: 00000100:00100000:1.0:1788796615.758352:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796615.758464:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959303040 00000100:00100000:0.0:1788796615.758471:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959303040 00010000:00010000:1.0:1788796615.758720:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd247d20800/0xdd273c88cfe2271d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e891 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796615.758742:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd247d20800/0xdd273c88cfe2271d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e891 expref: 12 pid: 5837 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796615.758768:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875688959303424:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796615.758823:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd247d21c00/0xdd273c88cfe22716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e88a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796615.758831:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd247d21c00/0xdd273c88cfe22716 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e88a expref: 12 pid: 5839 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796615.758839:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875688959303552:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788796615.758860:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd242e196c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796615.759044:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959303168 00000100:00100000:2.0:1788796615.759049:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959303168 00000100:00100000:2.0:1788796615.759079:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788796615.759091:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959303296 00000100:00100000:2.0:1788796615.759100:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959303296 00000100:00100000:2.0:1788796615.759121:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788796615.759129:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+5:11675:x1875688959303040:12345-0@lo:104: 00010000:00010000:2.0:1788796615.759142:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd267335000/0xdd273c88cfe22740 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22747 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.759198:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788796615.759204:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+5:11675:x1875688959303040:12345-0@lo:104: Request processed in 76us (3463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796615.759211:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788796615.759229:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788796615.759235:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261295c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+4:11675:x1875688959303168:12345-0@lo:104: 00010000:00010000:2.0:1788796615.759242:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd267334e00/0xdd273c88cfe22732 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22739 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.759274:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788796615.759279:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261295c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+4:11675:x1875688959303168:12345-0@lo:104: Request processed in 45us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796615.759285:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788796615.759312:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788796615.759318:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26725cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:11675:x1875688959303296:12345-0@lo:104: 00010000:00010000:2.0:1788796615.759325:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6200/0xdd273c88cfe22724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe2272b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.759351:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788796615.759356:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26725cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7f7145a2-0840-45a5-acde-da959fc7802f+3:11675:x1875688959303296:12345-0@lo:104: Request processed in 40us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796615.759362:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788796615.759730:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875688959303040:0@lo:104: 00000100:00100000:1.0:1788796615.759741:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261297b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875688959303168:0@lo:104: 00000100:00100000:1.0:1788796615.759768:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261297800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875688959303296:0@lo:104: 00010000:00010000:2.0:1788796615.759855:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788796615.759861:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd267335000/0xdd273c88cfe22740 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22747 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.759870:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335000 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:2.0:1788796615.759874:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd267335000/0xdd273c88cfe22740 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe22747 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.759883:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd267335000/0xdd273c88cfe22740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe22747 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796615.759892:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd267335000/0xdd273c88cfe22740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe22747 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796615.759970:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788796615.760006:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd267335000/0xdd273c88cfe22740 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22747 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760012:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796615.760036:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd267335000/0xdd273c88cfe22740 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22747 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760043:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd267335000/0xdd273c88cfe22740 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22747 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760056:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788796615.760059:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd267334e00/0xdd273c88cfe22732 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe22739 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760065:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334e00 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:2.0:1788796615.760067:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd267334e00/0xdd273c88cfe22732 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe22739 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760083:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd267334e00/0xdd273c88cfe22732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe22739 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796615.760089:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd267334e00/0xdd273c88cfe22732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe22739 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796615.760093:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788796615.760106:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd267334e00/0xdd273c88cfe22732 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22739 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760111:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796615.760127:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd267334e00/0xdd273c88cfe22732 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22739 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760134:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd267334e00/0xdd273c88cfe22732 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe22739 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760144:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796615.760147:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6200/0xdd273c88cfe22724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe2272b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760152:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6200 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:2.0:1788796615.760155:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6200/0xdd273c88cfe22724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe2272b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760161:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6200/0xdd273c88cfe22724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe2272b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796615.760166:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6200/0xdd273c88cfe22724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe2272b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796615.760177:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788796615.760189:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6200/0xdd273c88cfe22724 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe2272b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760195:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796615.760201:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6200/0xdd273c88cfe22724 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe2272b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760206:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6200/0xdd273c88cfe22724 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe2272b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760219:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796615.760221:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796615.760223:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796615.760230:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796615.760240:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd24121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959303680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796615.760277:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796615.760395:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd241219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959303808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796615.760420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796615.760439:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796615.760445:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd24121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959303936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796615.760466:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796615.760495:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959303680 00000100:00100000:2.0:1788796615.760500:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959303680 00010000:00010000:2.0:1788796615.760591:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd2466b7e00/0xdd273c88cfe22747 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22740 expref: 19 pid: 5837 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796615.760615:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959303808 00000100:00100000:2.0:1788796615.760623:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959303808 00010000:00010000:2.0:1788796615.760635:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe22739 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22732 expref: 20 pid: 5839 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796615.760645:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959303936 00000100:00100000:2.0:1788796615.760647:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959303936 00010000:00010000:2.0:1788796615.760654:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd267334c00/0xdd273c88cfe2272b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22724 expref: 21 pid: 5839 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796615.760678:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788796615.760685:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+21:3307:x1875688959303680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788796615.760696:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796615.760701:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd2466b7e00/0xdd273c88cfe22747 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22740 expref: 21 pid: 5837 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760711:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd2466b7e00/0xdd273c88cfe22747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe22740 expref: 21 pid: 5837 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760724:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd2466b7e00/0xdd273c88cfe22747 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe22740 expref: 21 pid: 5837 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760735:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796615.760787:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+20:3307:x1875688959303680:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796615.760793:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788796615.760806:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788796615.760812:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241219f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3304:x1875688959303808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788796615.760818:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796615.760822:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe22739 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22732 expref: 19 pid: 5839 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760839:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe22739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe22732 expref: 19 pid: 5839 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760848:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe22739 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe22732 expref: 19 pid: 5839 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.760858:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796615.760883:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241219f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+18:3304:x1875688959303808:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796615.760890:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788796615.761037:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788796615.761044:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd245991050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+17:3304:x1875688959303936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788796615.761051:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796615.761056:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd267334c00/0xdd273c88cfe2272b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe22724 expref: 17 pid: 5839 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.761064:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd267334c00/0xdd273c88cfe2272b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe22724 expref: 17 pid: 5839 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.761073:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd267334c00/0xdd273c88cfe2272b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe22724 expref: 17 pid: 5839 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.761081:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796615.761102:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd245991050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+16:3304:x1875688959303936:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796615.761107:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788796615.761164:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd24121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959303680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796615.761185:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd24121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959303936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796615.761214:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd241219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959303808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788796615.766427:0:8456:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1788796615.766693:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796615.766734:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796615.766788:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936199936 00000100:00100000:2.0:1788796615.766798:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936199936 00010000:00010000:2.0:1788796615.766839:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd247d20800/0xdd273c88cfe2271d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e891 expref: 13 pid: 5837 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796615.767027:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875688959303424:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788796615.767038:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875688959303552:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788796615.767077:0:11675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe2287b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796615.767198:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1788796615.767281:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936200064 00000100:00100000:2.0:1788796615.767287:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936200064 00010000:00010000:2.0:1788796615.767371:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd247d21c00/0xdd273c88cfe22716 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e88a expref: 14 pid: 5839 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796615.767435:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:2.0:1788796615.767445:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241219880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:039faa1e-567a-467b-be0f-2f39bb0eb94e+14:2358:x1875688936199936:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796615.767461:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796615.767467:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd247d20800/0xdd273c88cfe2271d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e891 expref: 14 pid: 5837 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.767479:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd247d20800/0xdd273c88cfe2271d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e891 expref: 14 pid: 5837 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.767497:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d20800/0xdd273c88cfe2271d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e891 expref: 14 pid: 5837 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.767603:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796615.767669:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241219880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936199936:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 216us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796615.767692:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:2.0:1788796615.767711:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:2.0:1788796615.767718:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:2357:x1875688936200064:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796615.767725:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796615.767731:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd247d21c00/0xdd273c88cfe22716 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e88a expref: 12 pid: 5839 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.767741:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd247d21c00/0xdd273c88cfe22716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e88a expref: 12 pid: 5839 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.767774:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d21c00/0xdd273c88cfe22716 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e88a expref: 12 pid: 5839 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.767785:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe2287b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.767796:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe2287b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.767811:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe2287b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.767818:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe2287b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.767825:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe2287b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.767832:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe2287b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.767844:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335a00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796615.767849:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe2287b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.767857:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe2287b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.767882:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe2287b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796615.767891:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796615.767922:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:2357:x1875688936200064:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 205us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796615.767929:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 34 00010000:00010000:3.0:1788796615.768819:0:11675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe2287b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796615.768846:0:11675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe2287b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796615.768853:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd267335a00/0xdd273c88cfe2287b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796616.026729:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796616.846596:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796616.850553:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936200192 00000100:00100000:3.0:1788796616.850573:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936200192 00000100:00100000:3.0:1788796616.850669:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 253 00000100:00100000:3.0:1788796616.850681:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:5599:x1875688936200192:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796616.850699:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796616.850720:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe22882 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e8de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796616.850771:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe22882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8de expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796616.850784:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe22882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8de expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796616.850794:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21a00, rc 0) 00000100:00100000:3.0:1788796616.850927:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:5599:x1875688936200192:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 247us (4341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796616.850934:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 253 00000100:00100000:1.0:1788796616.877238:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796616.877426:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936200320 00000100:00100000:2.0:1788796616.877437:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936200320 00000100:00100000:2.0:1788796616.877505:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 254 00000100:00100000:2.0:1788796616.877516:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24a490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:5599:x1875688936200320:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796616.877902:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24a490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:5599:x1875688936200320:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 386us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796616.877912:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 254 00000100:00100000:2.0:1788796616.890225:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796616.890381:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936200448 00000100:00100000:1.0:1788796616.890391:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936200448 00000100:00100000:1.0:1788796616.890452:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 255 00000100:00100000:1.0:1788796616.890462:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24a493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:5599:x1875688936200448:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796616.890712:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24a493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:5599:x1875688936200448:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 250us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796616.890720:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 255 00000100:00100000:1.0:1788796616.913440:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796616.913798:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936200576 00000100:00100000:3.0:1788796616.913811:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936200576 00000100:00100000:3.0:1788796616.913876:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 256 00000100:00100000:3.0:1788796616.913888:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd272493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:9949:x1875688936200576:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788796616.914132:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd272493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:9949:x1875688936200576:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 246us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796616.914139:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 256 00000100:00100000:3.0:1788796616.916819:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796616.918600:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936200704 00000100:00100000:2.0:1788796616.918613:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936200704 00000100:00100000:2.0:1788796616.918706:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 257 00000100:00100000:2.0:1788796616.918727:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd272492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:9949:x1875688936200704:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788796616.918998:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd272492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:9949:x1875688936200704:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 270us (2183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796616.919006:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 257 00000100:00100000:2.0:1788796616.931841:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796616.931938:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936200832 00000100:00100000:1.0:1788796616.931965:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936200832 00000100:00100000:1.0:1788796616.932037:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 258 00000100:00100000:1.0:1788796616.932048:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd272491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:5599:x1875688936200832:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796616.932067:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796616.932088:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd267334a00/0xdd273c88cfe22889 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e8e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796616.932117:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd267334a00/0xdd273c88cfe22889 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8e5 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796616.932130:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd267334a00/0xdd273c88cfe22889 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8e5 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796616.932149:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334a00, rc 0) 00000100:00100000:1.0:1788796616.932213:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd272491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:5599:x1875688936200832:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 167us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796616.932220:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 258 00000100:00100000:1.0:1788796616.936165:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796616.936378:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936200960 00000100:00100000:3.0:1788796616.936392:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936200960 00000100:00100000:3.0:1788796616.936507:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 259 00000100:00100000:3.0:1788796616.936528:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:5599:x1875688936200960:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796616.936911:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:5599:x1875688936200960:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 393us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796616.936920:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 259 00000100:00100000:1.0:1788796616.940107:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796616.940286:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936201088 00000100:00100000:2.0:1788796616.940297:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936201088 00000100:00100000:2.0:1788796616.940384:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 260 00000100:00100000:2.0:1788796616.940394:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:5599:x1875688936201088:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796616.941002:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:5599:x1875688936201088:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 606us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796616.941013:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 260 00000100:00100000:2.0:1788796616.945694:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796616.946133:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936201216 00000100:00100000:3.0:1788796616.946145:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936201216 00000100:00100000:3.0:1788796616.946261:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 261 00000100:00100000:3.0:1788796616.946272:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:9951:x1875688936201216:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788796616.946574:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:9951:x1875688936201216:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 303us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796616.946582:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 261 00000100:00100000:3.0:1788796616.978264:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796616.978780:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936201344 00000100:00100000:2.0:1788796616.978793:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936201344 00000100:00100000:2.0:1788796616.978863:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 262 00000100:00100000:2.0:1788796616.978875:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:9951:x1875688936201344:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788796616.979796:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:9951:x1875688936201344:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 918us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796616.979806:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 262 00010000:00010000:2.0:1788796617.052156:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788796617.625894:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788796617.625903:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd26717e800 from 7 10000000:01000000:1.0:1788796617.625908:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788796617.625971:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796617.625986:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796617.625999:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796617.626049:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959304064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788796617.626123:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796617.626188:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd242e19180 going to sleep for 11 seconds 00000100:00100000:3.0:1788796617.626430:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959304064 00000100:00100000:3.0:1788796617.626440:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959304064 00000100:00100000:3.0:1788796617.626506:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788796617.626516:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+16:5841:x1875688959304064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796617.626531:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796617.626617:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d21800/0xdd273c88cfe22897 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe22890 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796617.626661:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d21800/0xdd273c88cfe22897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe22890 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796617.626672:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d21800/0xdd273c88cfe22897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe22890 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796617.626681:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21800, rc 0) 00000100:00100000:3.0:1788796617.626828:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959304064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796617.626834:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788796617.627482:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959304064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796617.627500:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22897 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796617.627523:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22897 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796617.627599:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd24121ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959304192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796617.627644:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796617.627682:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247daad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788796617.629451:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959304192 00000100:00100000:1.0:1788796617.629473:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959304192 00000100:00100000:1.0:1788796617.629531:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788796617.629540:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959304192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796617.629875:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959304192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 335us (2229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796617.629882:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788796617.631139:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd24121ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959304192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788796617.631204:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd24121ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959304320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788796617.631278:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796617.631325:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247daad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788796617.634203:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959304320 00000100:00100000:1.0:1788796617.634225:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959304320 00000100:00100000:1.0:1788796617.634296:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788796617.634308:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959304320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796617.634564:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959304320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 258us (3284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796617.634572:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788796617.634797:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd24121ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959304320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796617.635225:0:11688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:11688:1875688959304448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796617.635276:0:11688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796617.635312:0:11688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24cbfc180 going to sleep for 11 seconds 00000100:00100000:3.0:1788796617.635417:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959304448 00000100:00100000:3.0:1788796617.635422:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959304448 00000100:00100000:3.0:1788796617.635459:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788796617.635468:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+17:11688:x1875688959304448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796617.635647:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+17:11688:x1875688959304448:12345-0@lo:502:llog_process_th.0 Request processed in 179us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796617.635654:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788796617.635823:0:11688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:11688:1875688959304448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788796617.635851:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788796617.635862:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796617.635864:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788796617.635871:0:11688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd26717e800 00000020:00000080:0.0:1788796617.635873:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788796617.635964:0:11688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a37800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:11688:1875688959304576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796617.636001:0:11688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796617.636030:0:11688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd245cfdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796617.636085:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959304576 00000100:00100000:3.0:1788796617.636090:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959304576 00000100:00100000:3.0:1788796617.636123:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788796617.636129:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+17:11688:x1875688959304576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796617.636258:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+17:11688:x1875688959304576:12345-0@lo:502:llog_process_th.0 Request processed in 129us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796617.636265:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788796617.637357:0:11688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a37800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:11688:1875688959304576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788796617.637399:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788796617.637407:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796617.637409:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788796617.637414:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788796617.638428:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788796617.638455:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788796617.638465:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22897 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796617.638479:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22897 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796617.638490:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788796617.638492:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd2467d7000 from 7 10000000:01000000:3.0:1788796617.638495:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788796617.638530:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796617.638539:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796617.638549:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796617.638572:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959304704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788796617.638641:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796617.638688:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48780 going to sleep for 11 seconds 00000100:00100000:0.0:1788796617.639080:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959304704 00000100:00100000:0.0:1788796617.639088:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959304704 00000100:00100000:0.0:1788796617.639130:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788796617.639140:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+17:5841:x1875688959304704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788796617.639156:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796617.639170:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2821d5400/0xdd273c88cfe228a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2289e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796617.639194:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2821d5400/0xdd273c88cfe228a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2289e expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796617.639206:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2821d5400/0xdd273c88cfe228a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2289e expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796617.639215:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5400, rc 0) 00000100:00100000:0.0:1788796617.639271:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959304704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796617.639277:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788796617.639416:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959304704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796617.639431:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe228a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796617.639441:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe228a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796617.639506:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959304832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796617.639533:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796617.639557:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48780 going to sleep for 11 seconds 00000100:00100000:1.0:1788796617.639616:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959304832 00000100:00100000:1.0:1788796617.639622:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959304832 00000100:00100000:1.0:1788796617.639667:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788796617.639675:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959304832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796617.639934:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959304832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796617.639947:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788796617.640340:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959304832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796617.640373:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959304960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796617.640416:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796617.640436:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48780 going to sleep for 11 seconds 00000100:00100000:3.0:1788796617.640448:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959304960 00000100:00100000:3.0:1788796617.640452:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959304960 00000100:00100000:3.0:1788796617.640470:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788796617.640477:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959304960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796617.640617:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959304960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796617.640623:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788796617.640683:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959304960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796617.642288:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:11689:1875688959305088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796617.642348:0:11689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796617.642392:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796617.642495:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959305088 00000100:00100000:0.0:1788796617.642503:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959305088 00000100:00100000:0.0:1788796617.642544:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788796617.642554:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+18:11689:x1875688959305088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796617.642808:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+18:11689:x1875688959305088:12345-0@lo:502:llog_process_th.0 Request processed in 256us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796617.642817:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788796617.643007:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:11689:1875688959305088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788796617.643039:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796617.643049:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796617.643051:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788796617.643057:0:11689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd2467d7000 00000020:00000080:3.0:1788796617.643065:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788796617.643143:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:11689:1875688959305216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796617.643180:0:11689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796617.643209:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796617.643992:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959305216 00000100:00100000:0.0:1788796617.644001:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959305216 00000100:00100000:0.0:1788796617.644044:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788796617.644054:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+18:11689:x1875688959305216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796617.644251:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+18:11689:x1875688959305216:12345-0@lo:502:llog_process_th.0 Request processed in 198us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796617.644258:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788796617.644473:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:11689:1875688959305216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788796617.644502:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796617.644508:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796617.644510:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788796617.644515:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788796617.644686:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788796617.644704:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788796617.644713:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe228a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796617.644724:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe228a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796617.644734:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788796617.644737:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd250afa000 from 7 10000000:01000000:3.0:1788796617.644740:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788796617.644792:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796617.644800:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796617.644810:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796617.644826:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959305344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788796617.644860:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796617.644888:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788796617.645010:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959305344 00000100:00100000:2.0:1788796617.645016:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959305344 00000100:00100000:2.0:1788796617.645045:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788796617.645053:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+18:5841:x1875688959305344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796617.645062:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796617.645075:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2466b7800/0xdd273c88cfe228b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe228ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796617.645097:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2466b7800/0xdd273c88cfe228b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe228ac expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796617.645121:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2466b7800/0xdd273c88cfe228b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe228ac expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796617.645129:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7800, rc 0) 00000100:00100000:2.0:1788796617.645169:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959305344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796617.645175:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788796617.647365:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959305344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796617.647390:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe228b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796617.647417:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe228b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796617.647492:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959305472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796617.647543:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796617.647581:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796617.647682:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959305472 00000100:00100000:0.0:1788796617.647689:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959305472 00000100:00100000:0.0:1788796617.647735:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788796617.647770:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24839e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959305472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796617.648050:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24839e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959305472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796617.648058:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788796617.648188:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959305472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796617.648216:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959305600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796617.648315:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796617.648344:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796617.648435:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959305600 00000100:00100000:0.0:1788796617.648440:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959305600 00000100:00100000:0.0:1788796617.648472:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788796617.648480:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959305600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796617.648923:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:5841:x1875688959305600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 443us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796617.648931:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788796617.657477:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267832680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7f7145a2-0840-45a5-acde-da959fc7802f:5841:1875688959305600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796617.657989:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:11692:1875688959305728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796617.658072:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796617.663091:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2467e3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788796617.667889:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959305728 00000100:00100000:2.0:1788796617.667905:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959305728 00000100:00100000:2.0:1788796617.667978:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788796617.667988:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:11692:x1875688959305728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796617.669032:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:11692:x1875688959305728:12345-0@lo:502:llog_process_th.0 Request processed in 1042us (10957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796617.669042:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000040:00080000:3.0:1788796617.670543:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788796617.673836:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:11692:1875688959305728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788796617.673900:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788796617.673911:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788796617.673913:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788796617.673921:0:11692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd250afa000 00000020:00000080:0.0:1788796617.673924:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788796617.674015:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a37800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:11692:1875688959305856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796617.674094:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796617.674135:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2459560c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796617.676382:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959305856 00000100:00100000:3.0:1788796617.676397:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959305856 00000100:00100000:3.0:1788796617.676457:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788796617.676467:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:11692:x1875688959305856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796617.676858:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:11692:x1875688959305856:12345-0@lo:502:llog_process_th.0 Request processed in 393us (2764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796617.676866:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788796617.676955:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a37800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7f7145a2-0840-45a5-acde-da959fc7802f:11692:1875688959305856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788796617.676987:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788796617.676994:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796617.676996:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788796617.677001:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788796617.677295:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788796617.677315:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788796617.677324:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe228b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796617.677336:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe228b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796618.074768:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796618.586010:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd24121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959306368:0@lo:400:kworker.0 00000100:00100000:0.0:1788796618.586063:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd241219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959306112:0@lo:400:kworker.0 00000100:00100000:2.0:1788796618.586086:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796618.586153:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd241219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959305984:0@lo:400:kworker.0 00000100:00100000:1.0:1788796618.586189:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd241219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959306240:0@lo:400:kworker.0 00000100:00100000:0.0:1788796618.588501:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796618.588595:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959306624:0@lo:400:kworker.0 00000100:00100000:0.0:1788796618.588655:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796618.588712:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959306112 00000100:00100000:0.0:1788796618.588721:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959306112 00000100:00100000:0.0:1788796618.588790:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788796618.588800:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959306112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796618.588855:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959306112:12345-0@lo:400:kworker.0 Request processed in 56us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796618.588862:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788796618.588886:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959306368 00000100:00100000:0.0:1788796618.588890:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959306368 00000100:00100000:0.0:1788796618.588922:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959306624 00000100:00100000:0.0:1788796618.588925:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959306624 00000100:00100000:0.0:1788796618.588947:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788796618.588953:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875688959306368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796618.588986:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875688959306368:12345-0@lo:400:kworker.0 Request processed in 34us (2902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796618.588992:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788796618.589003:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788796618.589010:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959306624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796618.589037:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959306624:12345-0@lo:400:kworker.0 Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796618.589042:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788796618.589062:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788796618.589080:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796618.589238:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd241219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959306112:0@lo:400:kworker.0 00010000:00080000:0.0:1788796618.589254:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd247d25c00 x1875688959306624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796618.589265:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959306624:0@lo:400:kworker.0 00000100:00100000:3.0:1788796618.589880:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796618.589938:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959306496:0@lo:400:kworker.0 00000100:00100000:3.0:1788796618.589970:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796618.590285:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959306496 00000100:00100000:3.0:1788796618.590294:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959306496 00000100:00100000:3.0:1788796618.590343:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788796618.590352:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959306496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796618.590406:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959306496:12345-0@lo:400:kworker.0 Request processed in 54us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796618.590412:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1788796618.590435:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796618.590460:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959306496:0@lo:400:kworker.0 00000100:00100000:0.0:1788796618.591128:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959305984 00000100:00100000:0.0:1788796618.591135:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959305984 00000100:00100000:0.0:1788796618.591304:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788796618.591314:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959305984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796618.591369:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959305984:12345-0@lo:400:kworker.0 Request processed in 57us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796618.591376:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788796618.591478:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd241219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959305984:0@lo:400:kworker.0 00000100:00100000:2.0:1788796618.594624:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd24121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959306368:0@lo:400:kworker.0 00000100:00100000:1.0:1788796618.597551:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796618.597670:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959306240 00000100:00100000:0.0:1788796618.597681:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959306240 00000100:00100000:0.0:1788796618.597770:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788796618.597779:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959306240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796618.597845:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959306240:12345-0@lo:400:kworker.0 Request processed in 67us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796618.597851:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1788796618.597922:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796618.598184:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd241219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959306240:0@lo:400:kworker.0 00000040:00080000:3.0:1788796618.714496:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788796619.099095:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796619.099176:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796619.099206:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959306752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796619.099282:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796619.099418:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959306752 00000100:00100000:1.0:1788796619.099428:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959306752 00000100:00100000:1.0:1788796619.099494:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788796619.099505:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959306752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796619.099542:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788796619.099610:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959306752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796619.099618:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788796619.101151:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267a35180 x1875688959306752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796619.101182:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959306752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796619.145586:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796619.145649:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796619.145829:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936201728 00000100:00100000:0.0:1788796619.145841:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936201728 00000100:00100000:0.0:1788796619.145924:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:0.0:1788796619.145940:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+5:2358:x1875688936201728:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796619.146029:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+5:2358:x1875688936201728:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 94us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796619.146057:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00080000:1.0:1788796619.146222:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796619.146359:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936201472 00000100:00100000:3.0:1788796619.146371:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936201472 00000100:00100000:3.0:1788796619.146408:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 279 00000100:00100000:3.0:1788796619.146415:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936201472:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796619.146455:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936201472:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 41us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796619.146461:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 279 00000100:00100000:2.0:1788796619.149040:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796619.149084:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796619.149177:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936201600 00000100:00100000:0.0:1788796619.149187:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936201600 00000100:00100000:0.0:1788796619.149253:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936201856 00000100:00100000:0.0:1788796619.149257:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936201856 00000100:00100000:0.0:1788796619.149287:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:0.0:1788796619.149297:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+5:2357:x1875688936201600:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796619.149371:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+5:2357:x1875688936201600:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 76us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796619.149379:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:0.0:1788796619.149397:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:0.0:1788796619.149404:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2357:x1875688936201856:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796619.149424:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2357:x1875688936201856:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 22us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796619.149429:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00080000:1.0:1788796619.149589:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788796620.122036:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788796620.202163:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:2.0:1788796620.634017:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796620.634041:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959306880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796620.634170:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796620.636435:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959306880 00000100:00100000:1.0:1788796620.636452:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959306880 00000100:00100000:1.0:1788796620.636548:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788796620.636561:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959306880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796620.636634:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796620.636724:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959306880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (2554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796620.636731:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788796620.636808:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788796620.636816:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd247d27100, transno 4294967300 00000100:00100000:1.0:1788796620.636843:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959306880:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788796620.637507:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788796621.146917:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796622.170328:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796623.194686:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796623.706563:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959307264:0@lo:400:kworker.0 00000100:00100000:1.0:1788796623.706635:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796623.706665:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959307008:0@lo:400:kworker.0 00000100:00100000:3.0:1788796623.706705:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796623.706771:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959307520:0@lo:400:kworker.0 00000100:00100000:0.0:1788796623.706772:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959307136:0@lo:400:kworker.0 00000100:00100000:3.0:1788796623.706799:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959307392:0@lo:400:kworker.0 00000100:00100000:3.0:1788796623.706827:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796623.706933:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959307008 00000100:00100000:3.0:1788796623.706940:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959307008 00000100:00100000:3.0:1788796623.706984:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788796623.706994:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959307008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796623.707047:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959307008:12345-0@lo:400:kworker.0 Request processed in 54us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796623.707054:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788796623.707240:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796623.707260:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959307648:0@lo:400:kworker.0 00000100:00100000:1.0:1788796623.707284:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796623.707322:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959307264 00000100:00100000:3.0:1788796623.707327:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959307264 00000100:00100000:3.0:1788796623.707372:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959307136 00000100:00100000:3.0:1788796623.707375:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959307136 00000100:00100000:3.0:1788796623.707393:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788796623.707399:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959307264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796623.707465:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959307264:12345-0@lo:400:kworker.0 Request processed in 53us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796623.707912:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788796623.707930:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788796623.707937:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959307136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796623.707972:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959307136:12345-0@lo:400:kworker.0 Request processed in 36us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796623.707978:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1788796623.707995:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796623.708014:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796623.708052:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959307008:0@lo:400:kworker.0 00000100:00100000:3.0:1788796623.708075:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959307520 00000100:00100000:3.0:1788796623.708079:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959307520 00000100:00100000:3.0:1788796623.708104:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788796623.708110:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959307520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796623.708155:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959307520:12345-0@lo:400:kworker.0 Request processed in 45us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796623.708161:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1788796623.708186:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796623.708214:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959307520:0@lo:400:kworker.0 00000100:00100000:3.0:1788796623.708258:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959307264:0@lo:400:kworker.0 00000100:00100000:1.0:1788796623.711431:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959307136:0@lo:400:kworker.0 00000100:00100000:0.0:1788796623.712611:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959307392 00000100:00100000:0.0:1788796623.712623:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959307392 00000100:00100000:2.0:1788796623.713796:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959307648 00000100:00100000:2.0:1788796623.713807:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959307648 00000100:00080000:3.0:1788796623.721110:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788796623.724023:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796623.725281:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788796623.725308:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959307392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796623.725411:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959307392:12345-0@lo:400:kworker.0 Request processed in 119us (18583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796623.725419:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788796623.725598:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959307392:0@lo:400:kworker.0 00000100:00100000:2.0:1788796623.732205:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788796623.732222:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959307648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796623.732323:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959307648:12345-0@lo:400:kworker.0 Request processed in 106us (25037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796623.732330:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788796623.732370:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27e36dc00 x1875688959307648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796623.732386:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959307648:0@lo:400:kworker.0 00000100:00100000:3.0:1788796624.218413:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959307776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796624.218507:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796624.219553:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959307776 00000100:00100000:0.0:1788796624.219565:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959307776 00000100:00100000:0.0:1788796624.219631:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788796624.219642:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959307776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788796624.219681:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788796624.219776:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959307776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796624.219783:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788796624.220047:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267a34000 x1875688959307776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796624.220067:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959307776:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788796624.220440:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796624.261841:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796624.261928:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796624.265961:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796624.266070:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936202112 00000100:00100000:3.0:1788796624.266081:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936202112 00000100:00100000:0.0:1788796624.266265:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936202368 00000100:00100000:0.0:1788796624.266270:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936202368 00000100:00100000:3.0:1788796624.266401:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 119 00000100:00100000:1.0:1788796624.266447:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936201984 00000100:00100000:1.0:1788796624.266452:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936201984 00000100:00100000:1.0:1788796624.266482:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 281 00000100:00100000:1.0:1788796624.266489:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2355:x1875688936201984:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796624.266572:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2355:x1875688936201984:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 83us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796624.266580:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 281 00000100:00080000:1.0:1788796624.266633:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796624.266695:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:0.0:1788796624.266704:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2355:x1875688936202368:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796624.266737:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2355:x1875688936202368:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 35us (4808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796624.266761:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:2.0:1788796624.267492:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796624.267560:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936202240 00000100:00100000:2.0:1788796624.267572:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936202240 00000100:00100000:2.0:1788796624.267610:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:2.0:1788796624.267619:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+5:2355:x1875688936202240:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796624.267654:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+5:2355:x1875688936202240:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 36us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796624.267660:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:3.0:1788796624.271891:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+5:2355:x1875688936202112:12345-192.168.201.25@tcp:400:kworker.0 00000100:00080000:1.0:1788796624.272074:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796624.272488:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+5:2355:x1875688936202112:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 6075us (10655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796624.272499:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 119 00010000:00010000:0.0:1788796625.241885:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796625.754559:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959307904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796625.754640:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796625.755074:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959307904 00000100:00100000:0.0:1788796625.755084:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959307904 00000100:00100000:0.0:1788796625.755169:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788796625.755179:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959307904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796625.755227:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788796625.755303:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796625.759790:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959307904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4601us (5138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796625.759805:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788796625.765429:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959307904:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788796626.267311:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796627.289936:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796628.314463:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796628.826520:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959308288:0@lo:400:kworker.0 00000100:00100000:2.0:1788796628.826633:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796628.826713:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796628.826719:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd241219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959308416:0@lo:400:kworker.0 00000100:00100000:2.0:1788796628.826784:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796628.827690:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959308288 00000100:00100000:0.0:1788796628.827704:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959308288 00000100:00100000:0.0:1788796628.827819:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788796628.827836:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959308288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796628.827918:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959308288:12345-0@lo:400:kworker.0 Request processed in 90us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796628.827925:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788796628.827953:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959308416 00000100:00100000:0.0:1788796628.827957:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959308416 00000100:00100000:0.0:1788796628.827984:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788796628.827993:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959308416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796628.828028:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959308416:12345-0@lo:400:kworker.0 Request processed in 37us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796628.828034:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788796628.828250:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959308160:0@lo:400:kworker.0 00000100:00100000:1.0:1788796628.828307:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796628.828343:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd241219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959308672:0@lo:400:kworker.0 00000100:00100000:1.0:1788796628.828376:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796628.828406:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788796628.828413:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959308032:0@lo:400:kworker.0 00000100:00100000:1.0:1788796628.828454:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796628.828487:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd24121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959308544:0@lo:400:kworker.0 00000100:00100000:1.0:1788796628.828510:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796628.828552:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959308672 00000100:00100000:1.0:1788796628.828557:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959308672 00000100:00100000:1.0:1788796628.828593:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788796628.828600:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959308672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796628.829072:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959308672:12345-0@lo:400:kworker.0 Request processed in 471us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796628.829080:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788796628.829105:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959308032 00000100:00100000:1.0:1788796628.829110:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959308032 00000100:00100000:1.0:1788796628.829136:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788796628.829143:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959308032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796628.829175:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959308032:12345-0@lo:400:kworker.0 Request processed in 33us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796628.829181:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788796628.829206:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959308160 00000100:00100000:1.0:1788796628.829210:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959308160 00000100:00100000:1.0:1788796628.829233:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959308544 00000100:00100000:1.0:1788796628.829248:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959308544 00000100:00100000:1.0:1788796628.829459:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788796628.829731:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959308160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796628.829793:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959308160:12345-0@lo:400:kworker.0 Request processed in 327us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796628.829799:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788796628.829811:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788796628.829817:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959308544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796628.829841:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959308544:12345-0@lo:400:kworker.0 Request processed in 24us (1330us total) trans 0 rc 0/0 00000100:00080000:2.0:1788796628.829947:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788796628.829953:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788796628.829956:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796628.830014:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd241219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959308416:0@lo:400:kworker.0 00000100:00100000:2.0:1788796628.830028:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959308288:0@lo:400:kworker.0 00000100:00100000:2.0:1788796628.830090:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959308032:0@lo:400:kworker.0 00000100:00100000:2.0:1788796628.830101:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd24121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959308544:0@lo:400:kworker.0 00000100:00100000:2.0:1788796628.830110:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959308160:0@lo:400:kworker.0 00010000:00080000:2.0:1788796628.830122:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd241219180 x1875688959308672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796628.830132:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd241219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959308672:0@lo:400:kworker.0 00000100:00100000:1.0:1788796628.833527:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000040:00080000:0.0:1788796628.954821:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788796629.337907:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796629.338245:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd241219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959308800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796629.338328:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796629.338593:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959308800 00000100:00100000:1.0:1788796629.338615:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959308800 00000100:00100000:1.0:1788796629.338670:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788796629.338680:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959308800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796629.338717:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788796629.338808:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959308800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796629.338816:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788796629.339524:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd241219f80 x1875688959308800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796629.339545:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd241219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959308800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796629.393244:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796629.393572:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796629.393852:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936202496 00000100:00100000:1.0:1788796629.393863:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936202496 00000100:00100000:2.0:1788796629.394057:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936202624 00000100:00100000:2.0:1788796629.394062:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936202624 00000100:00100000:2.0:1788796629.394126:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 124 00000100:00100000:2.0:1788796629.394137:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+5:2356:x1875688936202624:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796629.394214:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+5:2356:x1875688936202624:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 79us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796629.394232:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 124 00000100:00080000:0.0:1788796629.396016:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796629.396986:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 283 00000100:00100000:3.0:1788796629.397006:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2356:x1875688936202496:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796629.397216:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2356:x1875688936202496:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 217us (3981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796629.397239:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 283 00000100:00100000:2.0:1788796629.412690:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796629.413086:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936202752 00000100:00100000:1.0:1788796629.413096:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936202752 00000100:00100000:1.0:1788796629.413170:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:1.0:1788796629.413181:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+5:2354:x1875688936202752:12345-192.168.201.25@tcp:9:kworker.0 00000020:00000080:1.0:1788796629.413211:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe227ef 00000100:00080000:1.0:1788796629.413240:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9bd2672fa000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788796629.413310:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788796629.413579:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+2:2354:x1875688936202752:12345-192.168.201.25@tcp:9:kworker.0 Request processed in 399us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796629.413587:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00010000:00010000:1.0:1788796629.413642:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796629.414205:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00080000:3.0:1788796629.414711:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788796629.416840:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936202880 00000100:00100000:1.0:1788796629.416856:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936202880 00000100:00100000:1.0:1788796629.416957:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00100000:1.0:1788796629.416968:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936202880:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796629.417052:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936202880:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 86us (2848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796629.417059:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00080000:3.0:1788796629.417670:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788796630.363383:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788796630.408615:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad2796a3-2145-47da-88fb-baa43721bec1 00000020:00000080:0.0:1788796630.408625:0:6716:0:(genops.c:885:class_export_put()) final put ffff9bd2672f8800/ad2796a3-2145-47da-88fb-baa43721bec1 00000020:00000080:2.0:1788796630.408693:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd2672f8800/ad2796a3-2145-47da-88fb-baa43721bec1 for lustre-OST0000 00000020:00000080:2.0:1788796630.408783:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd2672fa000 for lustre-OST0000 00000100:00100000:3.0:1788796630.874183:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959308928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796630.874265:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796630.879344:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959308928 00000100:00100000:1.0:1788796630.879361:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959308928 00000100:00100000:1.0:1788796630.879446:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788796630.879468:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959308928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796630.879510:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796630.879606:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959308928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (5342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796630.879613:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788796630.879769:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788796630.879886:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959308928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788796631.385963:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796632.411379:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796633.434213:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796633.946036:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959309440:0@lo:400:kworker.0 00000100:00100000:0.0:1788796633.946104:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796633.946172:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788796633.946177:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd241219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959309312:0@lo:400:kworker.0 00000100:00100000:0.0:1788796633.946201:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796633.946248:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959309440 00000100:00100000:0.0:1788796633.946256:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959309440 00000100:00100000:0.0:1788796633.946311:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788796633.946322:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959309440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796633.946445:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd24121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959309184:0@lo:400:kworker.0 00000100:00100000:2.0:1788796633.946475:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796633.946496:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959309696:0@lo:400:kworker.0 00000100:00100000:2.0:1788796633.946515:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796633.946536:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788796633.946543:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd241219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959309056:0@lo:400:kworker.0 00000100:00100000:2.0:1788796633.946569:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796633.946613:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959309568:0@lo:400:kworker.0 00000100:00100000:2.0:1788796633.946634:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796633.946658:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959309696 00000100:00100000:2.0:1788796633.946662:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959309696 00000100:00100000:2.0:1788796633.946688:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788796633.946695:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959309696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796633.946738:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959309696:12345-0@lo:400:kworker.0 Request processed in 44us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796633.946766:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788796633.946789:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959309312 00000100:00100000:2.0:1788796633.946792:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959309312 00000100:00100000:2.0:1788796633.946816:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959309184 00000100:00100000:2.0:1788796633.946820:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959309184 00000100:00100000:2.0:1788796633.946831:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959309568 00000100:00100000:2.0:1788796633.946833:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959309568 00000100:00100000:2.0:1788796633.946856:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788796633.946862:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959309312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796633.946899:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959309312:12345-0@lo:400:kworker.0 Request processed in 37us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796633.946905:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788796633.946916:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788796633.946921:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959309184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796633.946947:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959309184:12345-0@lo:400:kworker.0 Request processed in 26us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796633.946952:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788796633.946964:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788796633.946969:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959309568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796633.946995:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959309568:12345-0@lo:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796633.947000:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788796633.947019:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959309056 00000100:00100000:2.0:1788796633.947023:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959309056 00000100:00100000:2.0:1788796633.947042:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788796633.947048:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959309056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796633.947073:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959309056:12345-0@lo:400:kworker.0 Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796633.947079:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788796633.947122:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd241219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959309056:0@lo:400:kworker.0 00000100:00100000:2.0:1788796633.947135:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959309568:0@lo:400:kworker.0 00000100:00100000:2.0:1788796633.947143:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd24121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959309184:0@lo:400:kworker.0 00010000:00080000:2.0:1788796633.947163:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267998700 x1875688959309696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796633.947172:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959309696:0@lo:400:kworker.0 00000100:00100000:2.0:1788796633.947221:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd241219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959309312:0@lo:400:kworker.0 00000100:00080000:3.0:1788796633.947718:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788796633.947725:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788796633.947727:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796633.947940:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959309440:12345-0@lo:400:kworker.0 Request processed in 1619us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796633.947948:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788796633.948101:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959309440:0@lo:400:kworker.0 00010000:00010000:0.0:1788796634.457998:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796634.458553:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959309824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796634.458648:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796634.458828:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959309824 00000100:00100000:3.0:1788796634.458839:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959309824 00000100:00100000:3.0:1788796634.458892:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788796634.458901:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959309824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788796634.458940:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788796634.459000:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959309824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796634.459008:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788796634.459291:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd26799b800 x1875688959309824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796634.459313:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959309824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796634.505924:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796634.505972:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796634.506009:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796634.506126:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936203264 00000100:00100000:3.0:1788796634.506138:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936203264 00000100:00100000:3.0:1788796634.506201:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936203136 00000100:00100000:3.0:1788796634.506205:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936203136 00000100:00100000:3.0:1788796634.506233:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 129 00000100:00100000:3.0:1788796634.506242:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2358:x1875688936203264:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796634.506325:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2358:x1875688936203264:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 83us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796634.506347:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 129 00000100:00100000:3.0:1788796634.506366:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 130 00000100:00100000:3.0:1788796634.506373:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+5:2358:x1875688936203136:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796634.506400:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+5:2358:x1875688936203136:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 28us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796634.506405:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 130 00000100:00080000:0.0:1788796634.506598:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796634.507370:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936203008 00000100:00100000:1.0:1788796634.507380:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936203008 00000100:00100000:1.0:1788796634.507431:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 285 00000100:00100000:1.0:1788796634.507439:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936203008:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796634.507490:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936203008:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 51us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796634.507497:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 285 00010000:00010000:1.0:1788796635.482139:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796636.003201:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959309952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796636.003280:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796636.003656:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959309952 00000100:00100000:3.0:1788796636.003667:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959309952 00000100:00100000:3.0:1788796636.003762:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788796636.003772:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959309952:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788796636.003953:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788796636.004927:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796636.010086:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959309952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6304us (6794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796636.010102:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788796636.022702:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959309952:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788796636.517323:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796637.536559:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788796638.172683:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788796638.561345:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796639.067925:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959310464:0@lo:400:kworker.0 00000100:00100000:2.0:1788796639.068032:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796639.068109:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788796639.068116:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959310336:0@lo:400:kworker.0 00000100:00100000:2.0:1788796639.068155:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796639.068192:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959310464 00000100:00100000:2.0:1788796639.068203:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959310464 00000100:00100000:2.0:1788796639.068287:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788796639.068299:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959310464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796639.068365:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959310464:12345-0@lo:400:kworker.0 Request processed in 68us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796639.068384:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788796639.068440:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959310464:0@lo:400:kworker.0 00000100:00100000:1.0:1788796639.068553:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959310208:0@lo:400:kworker.0 00000100:00100000:1.0:1788796639.068590:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796639.068623:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959310720:0@lo:400:kworker.0 00000100:00100000:1.0:1788796639.068648:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796639.068677:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788796639.068684:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959310080:0@lo:400:kworker.0 00000100:00100000:1.0:1788796639.068712:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796639.068731:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959310592:0@lo:400:kworker.0 00000100:00100000:1.0:1788796639.068786:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788796639.068817:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788796639.068831:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959310720 00000100:00100000:1.0:1788796639.068836:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959310720 00000100:00100000:1.0:1788796639.068876:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788796639.068886:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959310720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796639.068927:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959310720:12345-0@lo:400:kworker.0 Request processed in 43us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796639.068952:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788796639.068981:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959310336 00000100:00100000:1.0:1788796639.068985:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959310336 00000100:00100000:1.0:1788796639.069016:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959310208 00000100:00100000:1.0:1788796639.069020:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959310208 00000100:00100000:1.0:1788796639.069033:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959310592 00000100:00100000:1.0:1788796639.069036:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959310592 00000100:00100000:1.0:1788796639.069051:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788796639.069059:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959310336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796639.069100:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959310336:12345-0@lo:400:kworker.0 Request processed in 42us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796639.069107:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788796639.069120:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788796639.069127:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959310208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796639.069155:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959310208:12345-0@lo:400:kworker.0 Request processed in 29us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796639.069161:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788796639.069174:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788796639.069180:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959310592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796639.069207:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959310592:12345-0@lo:400:kworker.0 Request processed in 28us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796639.069212:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1788796639.069235:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788796639.069238:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788796639.069273:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959310592:0@lo:400:kworker.0 00000100:00100000:1.0:1788796639.069285:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959310208:0@lo:400:kworker.0 00010000:00080000:1.0:1788796639.069307:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27e846680 x1875688959310720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796639.069319:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959310720:0@lo:400:kworker.0 00000100:00100000:1.0:1788796639.069354:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959310336:0@lo:400:kworker.0 00000100:00100000:3.0:1788796639.070138:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959310080 00000100:00100000:3.0:1788796639.070155:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959310080 00000100:00100000:3.0:1788796639.070220:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788796639.070232:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959310080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796639.070322:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959310080:12345-0@lo:400:kworker.0 Request processed in 93us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796639.070329:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788796639.072595:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959310080:0@lo:400:kworker.0 00010000:00010000:3.0:1788796639.581023:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796639.581131:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788796639.581357:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959310848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796639.581458:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796639.581782:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959310848 00000100:00100000:1.0:1788796639.581793:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959310848 00000100:00100000:1.0:1788796639.581865:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788796639.581879:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959310848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796639.581934:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788796639.582012:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959310848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796639.582020:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788796639.582199:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267999180 x1875688959310848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796639.582252:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959310848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796639.624875:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796639.624938:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796639.624974:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796639.625134:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936203648 00000100:00100000:3.0:1788796639.625152:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936203648 00000100:00100000:1.0:1788796639.625176:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936203520 00000100:00100000:1.0:1788796639.625189:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936203520 00000100:00100000:1.0:1788796639.625277:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 134 00000100:00100000:1.0:1788796639.625292:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+5:2355:x1875688936203520:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796639.625367:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936203392 00000100:00100000:2.0:1788796639.625372:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936203392 00000100:00080000:0.0:1788796639.625408:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796639.625419:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 287 00000100:00100000:1.0:1788796639.625419:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+5:2355:x1875688936203520:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 127us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796639.625429:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 134 00000100:00100000:2.0:1788796639.625430:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2355:x1875688936203392:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796639.625454:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 135 00000100:00100000:2.0:1788796639.625459:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2355:x1875688936203392:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 33us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796639.625461:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2355:x1875688936203648:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796639.625466:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 287 00000100:00100000:1.0:1788796639.625491:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2355:x1875688936203648:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 31us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796639.625497:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 135 00010000:00010000:3.0:1788796640.611525:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788796641.047000:0:11860:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 11:57:19 (1788796639) 00000100:00100000:0.0:1788796641.114616:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796641.114645:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959310976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796641.114731:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796641.118400:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959310976 00000100:00100000:2.0:1788796641.118417:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959310976 00000100:00100000:2.0:1788796641.118503:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788796641.118515:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959310976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788796641.118599:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796641.118693:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959310976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 181us (3961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796641.118701:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788796641.118784:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959310976:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788796641.119015:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788796641.626438:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796642.651376:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796642.698246:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796642.703833:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936203776 00000100:00100000:3.0:1788796642.703849:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936203776 00000100:00100000:3.0:1788796642.703946:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:3.0:1788796642.703961:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:10221:x1875688936203776:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788796642.703995:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796642.704020:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe228ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e8ec expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.704114:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe228c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.704130:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe228c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.704144:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe228c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796642.704181:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788796642.704197:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788796642.704235:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe228c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.704260:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe228ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8ec expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.704281:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe228c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8ec expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.704291:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bb00) 00010000:00010000:3.0:1788796642.704294:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788796642.704298:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20c00, rc 0) 00000100:00100000:3.0:1788796642.704373:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:10221:x1875688936203776:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 418us (6136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796642.704381:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00080000:0.0:1788796642.705043:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796642.716429:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796642.716534:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936203904 00000100:00100000:0.0:1788796642.716544:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936203904 00000100:00100000:0.0:1788796642.716671:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:0.0:1788796642.716682:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+6:10222:x1875688936203904:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788796642.716704:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796642.716726:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe228c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e8f3 expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717277:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe228cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717292:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe228cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717306:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe228cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717319:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe228d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717326:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe228d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717332:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe228d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717551:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe228dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717561:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe228dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717648:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe228dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796642.717678:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788796642.717682:0:10139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788796642.717705:0:10139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe228dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717716:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe228cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717722:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe228cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717730:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe228cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717736:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796642.717740:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe228cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717777:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe228cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717980:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bb00) 00010000:00010000:0.0:1788796642.717984:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796642.717990:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe228cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.717998:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe228cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.718023:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe228d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.718097:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe228d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.718104:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe228d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.718108:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796642.718111:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe228d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.718117:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe228d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.718126:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bd24d5f1200) 00010000:00010000:0.0:1788796642.718128:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796642.718131:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe228d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.718137:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe228d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.718173:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe228c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8f3 expref: 8 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.718198:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe228dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8f3 expref: 7 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796642.718218:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd24d5f1c00) 00010000:00010000:0.0:1788796642.718220:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788796642.718223:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d4000, rc 0) 00000100:00100000:0.0:1788796642.718303:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:10222:x1875688936203904:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1623us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796642.718312:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:2.0:1788796642.728936:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796642.729674:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936204160 00000100:00100000:3.0:1788796642.729686:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936204160 00000100:00100000:3.0:1788796642.729799:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:3.0:1788796642.729810:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+7:10222:x1875688936204160:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788796642.729833:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796642.729866:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe228e4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e8fa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.729938:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe228eb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.729952:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe228eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.729964:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe228eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.729979:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe228f2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.729986:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe228f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.729992:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe228f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730343:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe228f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730352:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe228f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730359:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe228f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796642.730378:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788796642.730539:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe228eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730547:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe228eb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730555:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe228eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730560:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796642.730569:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe228eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730577:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe228eb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730590:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd24d5f1c00) 00010000:00010000:3.0:1788796642.730593:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796642.730597:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe228eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730603:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe228eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730615:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe228f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730621:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe228f2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730637:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe228f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730642:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796642.730645:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe228f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730652:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe228f2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730660:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bd24712be00) 00010000:00010000:3.0:1788796642.730663:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796642.730666:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe228f2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.730671:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe228f2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.731173:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe228e4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8fa expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.731202:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe228f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8fa expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796642.731210:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:3.0:1788796642.731213:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796642.731215:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21c00, rc 0) 00000100:00100000:3.0:1788796642.731282:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+9:10222:x1875688936204160:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1474us (2358us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788796642.731298:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:2.0:1788796642.745111:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796642.745215:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936204288 00000100:00100000:1.0:1788796642.745226:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936204288 00000100:00100000:1.0:1788796642.745291:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:1.0:1788796642.745301:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+9:10222:x1875688936204288:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788796642.745417:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+9:10222:x1875688936204288:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 Request processed in 116us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796642.745424:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00000040:00080000:0.0:1788796643.295895:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788796643.673952:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796644.186111:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959311360:0@lo:400:kworker.0 00000100:00100000:0.0:1788796644.186205:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796644.186278:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796644.186287:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959311488:0@lo:400:kworker.0 00000100:00100000:0.0:1788796644.186313:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796644.186367:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959311360 00000100:00100000:0.0:1788796644.186376:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959311360 00000100:00100000:0.0:1788796644.186434:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788796644.186443:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959311360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796644.186494:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959311360:12345-0@lo:400:kworker.0 Request processed in 53us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796644.186501:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788796644.186523:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959311488 00000100:00100000:0.0:1788796644.186527:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959311488 00000100:00100000:1.0:1788796644.186740:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959311104:0@lo:400:kworker.0 00000100:00100000:1.0:1788796644.186801:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796644.186827:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959311616:0@lo:400:kworker.0 00000100:00100000:1.0:1788796644.186867:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796644.186900:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788796644.186906:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959311232:0@lo:400:kworker.0 00000100:00100000:1.0:1788796644.186952:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796644.186986:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959311744:0@lo:400:kworker.0 00000100:00100000:1.0:1788796644.187027:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796644.187079:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959311104 00000100:00100000:1.0:1788796644.187096:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959311104 00000100:00100000:1.0:1788796644.187184:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788796644.187208:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959311104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796644.187276:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959311104:12345-0@lo:400:kworker.0 Request processed in 85us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796644.187282:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788796644.187309:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959311616 00000100:00100000:1.0:1788796644.187312:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959311616 00000100:00100000:1.0:1788796644.187333:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959311232 00000100:00100000:1.0:1788796644.187347:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959311232 00000100:00100000:1.0:1788796644.187365:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788796644.187371:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959311616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796644.187402:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959311616:12345-0@lo:400:kworker.0 Request processed in 32us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796644.187408:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788796644.187419:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788796644.187425:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959311232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796644.187451:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959311232:12345-0@lo:400:kworker.0 Request processed in 26us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796644.187456:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788796644.187473:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959311744 00000100:00100000:1.0:1788796644.187477:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959311744 00000100:00100000:1.0:1788796644.187505:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788796644.187512:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959311744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796644.187556:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959311744:12345-0@lo:400:kworker.0 Request processed in 45us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796644.187562:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788796644.187605:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959311232:0@lo:400:kworker.0 00010000:00080000:1.0:1788796644.187619:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd26799b800 x1875688959311744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788796660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796644.187628:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959311744:0@lo:400:kworker.0 00000100:00100000:1.0:1788796644.187636:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959311104:0@lo:400:kworker.0 00000100:00100000:1.0:1788796644.187644:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959311616:0@lo:400:kworker.0 00000100:00080000:2.0:1788796644.187888:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788796644.187893:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788796644.187895:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796644.187924:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959311360:0@lo:400:kworker.0 00000100:00100000:0.0:1788796644.188071:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788796644.188096:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959311488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796644.188185:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959311488:12345-0@lo:400:kworker.0 Request processed in 69us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796644.188215:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788796644.188323:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959311488:0@lo:400:kworker.0 00010000:00010000:3.0:1788796644.698382:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796644.712567:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796644.712592:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959311872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796644.712667:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796644.712782:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959311872 00000100:00100000:1.0:1788796644.712790:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959311872 00000100:00100000:1.0:1788796644.712844:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788796644.712854:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959311872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796644.712891:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788796644.712943:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959311872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796644.712950:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788796644.713203:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27e36c000 x1875688959311872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796644.713222:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959311872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796644.743535:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796644.743575:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796644.743601:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796644.743629:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936204544 00000100:00100000:3.0:1788796644.743639:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936204544 00000100:00100000:3.0:1788796644.743714:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936204672 00000100:00100000:3.0:1788796644.743717:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936204672 00000100:00100000:3.0:1788796644.743781:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 139 00000100:00100000:3.0:1788796644.743792:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+9:2358:x1875688936204544:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796644.743880:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+9:2358:x1875688936204544:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 90us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796644.743888:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 139 00000100:00100000:3.0:1788796644.743908:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 140 00000100:00100000:3.0:1788796644.743916:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2358:x1875688936204672:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796644.743944:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2358:x1875688936204672:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 29us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796644.743965:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 140 00000100:00100000:3.0:1788796644.743986:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936204416 00000100:00100000:3.0:1788796644.743990:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936204416 00000100:00100000:3.0:1788796644.744027:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 289 00000100:00100000:3.0:1788796644.744034:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936204416:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796644.744059:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936204416:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 26us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796644.744065:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 289 00000100:00080000:3.0:1788796644.744092:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796645.536962:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796645.539092:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936204800 00000100:00100000:1.0:1788796645.539109:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936204800 00000100:00100000:1.0:1788796645.539190:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:1.0:1788796645.539201:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+9:10265:x1875688936204800:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796645.539222:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796645.539289:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22907 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e901 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539355:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2290e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539370:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2290e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539384:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2290e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539399:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22915 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539406:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22915 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539424:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22915 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539651:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2290e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539659:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2290e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539665:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2290e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539670:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796645.539674:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2290e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539680:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2290e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539693:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bb00) 00010000:00010000:1.0:1788796645.539695:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796645.539700:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2290e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539706:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2290e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539717:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22915 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539723:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22915 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539735:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22915 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.539740:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334c00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796645.541721:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22915 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.541864:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22915 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.541885:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bd255d57200) 00010000:00010000:1.0:1788796645.541888:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796645.541894:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22915 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.541901:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22915 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.541970:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22907 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e901 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.541981:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bb00) 00010000:00010000:1.0:1788796645.541984:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796645.541987:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22907 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e901 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.541997:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335000, rc 0) 00000100:00100000:1.0:1788796645.542461:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+9:10265:x1875688936204800:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 3260us (5508us total) trans 0 rc 301/301 00000100:00100000:1.0:1788796645.542485:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:3.0:1788796645.561597:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796645.563947:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936205056 00000100:00100000:2.0:1788796645.563963:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936205056 00000100:00100000:2.0:1788796645.564047:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:2.0:1788796645.564058:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+9:10265:x1875688936205056:12345-192.168.201.25@tcp:36:lfs.0 00010000:00010000:0.0:1788796645.564157:0:10139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796645.564186:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe228c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8ec expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.564207:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bb00) 00010000:00010000:0.0:1788796645.564220:0:10139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788796645.567456:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe2291c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.567478:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe2291c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.567490:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe2291c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.567504:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22923 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.567511:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22923 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.567517:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22923 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796645.570308:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788796645.570327:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe2291c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.570479:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe2291c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.570497:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe2291c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.570504:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796645.570509:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe2291c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.570518:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe2291c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.570534:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1200) 00010000:00010000:0.0:1788796645.570538:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796645.570544:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe2291c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.570550:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe2291c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788796645.570570:0:10139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b03e3bc9 reply state 00000000e8dced9b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22923 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796645.570580:0:10139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788796645.570737:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+10:10265:x1875688936205056:12345-192.168.201.25@tcp:36:lfs.0 Request processed in 6676us (9147us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788796645.570776:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 37 00010000:00010000:1.0:1788796645.575426:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22923 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.575445:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22923 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.575453:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22923 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.575460:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796645.575465:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22923 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.575473:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22923 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.575490:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bd24d5f1a00) 00010000:00010000:1.0:1788796645.575494:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796645.575498:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22923 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.575505:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22923 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796645.653435:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796645.653562:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936205184 00000100:00100000:0.0:1788796645.653573:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936205184 00000100:00100000:0.0:1788796645.653703:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:0.0:1788796645.653714:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+9:10273:x1875688936205184:12345-192.168.201.25@tcp:101:lctl.0 00010000:00010000:0.0:1788796645.653777:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796645.653802:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe2292a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e908 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.653890:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe22931 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.653903:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe22931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.653914:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe22931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796645.653946:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788796645.653950:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788796645.654002:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe22931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.654028:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe2292a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e908 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.654046:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe22931 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e908 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.654054:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1200) 00010000:00010000:0.0:1788796645.654057:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788796645.654061:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5600, rc 0) 00000100:00100000:0.0:1788796645.654152:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+10:10273:x1875688936205184:12345-192.168.201.25@tcp:101:lctl.0 Request processed in 440us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796645.654159:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00010000:00010000:0.0:1788796645.723152:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796645.727211:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796645.728262:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936205312 00000100:00100000:1.0:1788796645.728280:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936205312 00000100:00100000:1.0:1788796645.728344:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:1.0:1788796645.728355:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+10:10279:x1875688936205312:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796645.728379:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796645.728413:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22938 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e90f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.728487:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2293f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.728505:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2293f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.728519:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2293f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.728535:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22946 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.728542:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.728548:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729304:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2294d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729318:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2294d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729326:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2294d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796645.729380:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788796645.729385:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796645.729424:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2294d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729444:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2293f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729451:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2293f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729457:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2293f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729462:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796645.729467:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2293f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729474:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2293f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729485:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1200) 00010000:00010000:1.0:1788796645.729488:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796645.729494:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2293f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729501:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2293f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729526:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729534:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22946 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729540:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729552:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796645.729556:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729562:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22946 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729570:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bd255d57200) 00010000:00010000:1.0:1788796645.729573:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796645.729576:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22946 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729582:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22946 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729619:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22938 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e90f expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729632:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2294d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e90f expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.729639:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796645.729641:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788796645.729644:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334200, rc 0) 00000100:00100000:1.0:1788796645.729717:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+11:10279:x1875688936205312:12345-192.168.201.25@tcp:101:bash.0 Request processed in 1364us (2516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796645.729726:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:3.0:1788796645.734659:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796645.735055:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936205568 00000100:00100000:1.0:1788796645.735075:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936205568 00000100:00100000:1.0:1788796645.735146:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:1.0:1788796645.735158:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+11:10279:x1875688936205568:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796645.735180:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796645.735204:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22954 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e916 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.735439:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe2295b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.735455:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe2295b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.735466:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe2295b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.735525:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22962 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.735534:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.735540:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788796645.736281:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788796645.736549:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22969 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.736560:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.736581:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.736618:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe2295b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.736625:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe2295b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.736631:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe2295b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.736636:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796645.736640:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe2295b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.736647:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe2295b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.736658:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796645.736660:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796645.736665:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe2295b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.736671:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe2295b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788796645.736683:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5208d05 reply state 00000000a26cf5ee transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796645.736691:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788796645.736731:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22954 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e916 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.736776:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22969 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e916 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.736784:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:1.0:1788796645.736786:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796645.736788:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335400, rc 0) 00000100:00100000:1.0:1788796645.736860:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+14:10279:x1875688936205568:12345-192.168.201.25@tcp:101:bash.0 Request processed in 1704us (2213us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788796645.736869:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:3.0:1788796645.745284:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:3.0:1788796645.745318:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796645.745343:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22962 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796645.745352:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22962 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796645.745359:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796645.745364:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22962 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796645.745373:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22962 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796645.745400:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd255d57400) 00010000:00010000:3.0:1788796645.745404:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796645.745410:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22962 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796645.745417:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22962 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796645.745429:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936205696 00000100:00100000:1.0:1788796645.745438:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936205696 00000100:00100000:1.0:1788796645.745473:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:1.0:1788796645.745482:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875688936205696:12345-192.168.201.25@tcp:8:bash.0 00010000:00080000:1.0:1788796645.745512:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp t0 exp 0000000000000000 cur 372 last 0 00000020:00000080:1.0:1788796645.745539:0:6692:0:(genops.c:1384:class_connect()) connect: client ad2796a3-2145-47da-88fb-baa43721bec1, cookie 0xdd273c88cfe22977 00002000:00100000:1.0:1788796645.745550:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ad2796a3-2145-47da-88fb-baa43721bec1/ffff9bd27cfad800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788796645.745560:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788796645.745769:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788796645.745799:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9bd27cfa9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788796645.745866:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2354:x1875688936205696:12345-192.168.201.25@tcp:8:bash.0 Request processed in 383us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796645.745874:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:3.0:1788796645.749874:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796645.750092:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936205824 00000100:00100000:0.0:1788796645.750105:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936205824 00000100:00100000:0.0:1788796645.750198:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:0.0:1788796645.750209:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+6:0:x1875688936205824:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1788796645.750229:0:11435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796645.750253:0:11435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe2297e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e91d expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788796645.750283:0:11435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796645.750300:0:11435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1788796645.750304:0:11435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796645.750313:0:11435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe2297e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e91d expref: 7 pid: 11435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.750343:0:11435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe2297e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e91d expref: 7 pid: 11435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.750357:0:11435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d4600, rc 0) 00000100:00100000:0.0:1788796645.750409:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:0:x1875688936205824:12345-192.168.201.25@tcp:101:bash.0 Request processed in 202us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796645.750416:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00080000:3.0:1788796645.750582:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788796645.756616:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796645.756678:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936205952 00000100:00100000:2.0:1788796645.756687:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936205952 00000100:00100000:2.0:1788796645.756732:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:2.0:1788796645.756739:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:10279:x1875688936205952:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1788796645.756776:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796645.756797:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e924 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796645.756828:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe2297e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e91d expref: 8 pid: 11435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796645.756837:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796645.756841:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796645.756846:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796645.756879:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe2297e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e91d expref: 8 pid: 11435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796645.756890:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe2297e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e91d expref: 8 pid: 11435 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796645.756908:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e846d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1875688959312000:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796645.756976:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2671edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788796645.761312:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796645.761526:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e846d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1875688959312000:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788796645.761559:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796645.761579:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7a00, rc 0) 00000100:00100000:3.0:1788796645.761645:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+8:10279:x1875688936205952:12345-192.168.201.25@tcp:101:bash.0 Request processed in 4904us (5035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796645.761655:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:3.0:1788796645.761699:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936206080 00000100:00100000:3.0:1788796645.761706:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936206080 00010000:00010000:3.0:1788796645.761737:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe2297e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e91d expref: 8 pid: 11435 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796645.761808:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:3.0:1788796645.761817:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267999500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+8:2357:x1875688936206080:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796645.761831:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796645.761869:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe2297e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e91d expref: 8 pid: 11435 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796645.761883:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe2297e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e91d expref: 8 pid: 11435 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796645.761912:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe2297e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e91d expref: 8 pid: 11435 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796645.761929:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796645.761934:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796645.761943:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796645.761955:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796645.762006:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796645.762019:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1875688959312128:192.168.201.25@tcp:105: 00000100:00100000:3.0:1788796645.762070:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2466e1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796645.767152:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5830:1875688959312128:192.168.201.25@tcp:105: 00010000:00010000:0.0:1788796645.767182:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796645.768154:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267999500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936206080:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 6331us (6844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796645.768169:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:0.0:1788796645.769859:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796645.770118:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936206336 00000100:00100000:3.0:1788796645.770154:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936206336 00000100:00100000:3.0:1788796645.770216:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:3.0:1788796645.770228:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+13:10279:x1875688936206336:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:3.0:1788796645.770587:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+14:10279:x1875688936206336:12345-192.168.201.25@tcp:35:bash.0 Request processed in 360us (736us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788796645.770594:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000001:00080000:2.0:1788796645.779178:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:1.0:1788796645.846396:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796645.849199:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936206592 00000100:00100000:0.0:1788796645.849233:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936206592 00000100:00100000:0.0:1788796645.849310:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:0.0:1788796645.849320:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+12:10289:x1875688936206592:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788796645.849343:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796645.849361:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe2298c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e92b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796645.849464:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788796645.849606:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe2298c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e92b expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.849622:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1200) 00010000:00010000:0.0:1788796645.849625:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788796645.849631:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe2298c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e92b expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.849646:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5e00, rc 0) 00000100:00100000:0.0:1788796645.849711:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+13:10289:x1875688936206592:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 393us (3325us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1788796645.849719:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:2.0:1788796645.855835:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796645.855907:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936206848 00000100:00100000:0.0:1788796645.855917:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936206848 00000100:00100000:0.0:1788796645.855971:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:0.0:1788796645.855990:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+13:10289:x1875688936206848:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:0.0:1788796645.856267:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+14:10289:x1875688936206848:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 286us (448us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788796645.856275:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1788796645.934364:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796645.934493:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936206976 00000100:00100000:1.0:1788796645.934506:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936206976 00000100:00100000:1.0:1788796645.934580:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:1.0:1788796645.934591:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+14:10295:x1875688936206976:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796645.934619:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796645.934641:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe2299a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e932 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.934713:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe229a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.934728:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe229a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.934740:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe229a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796645.934828:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788796645.934832:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796645.934855:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe229a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.934880:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe2299a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e932 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.934900:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe229a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e932 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.934909:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796645.934912:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788796645.934931:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335a00, rc 0) 00000100:00100000:1.0:1788796645.935165:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+15:10295:x1875688936206976:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 575us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796645.935173:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:1.0:1788796645.941896:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796645.942067:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936207232 00000100:00100000:0.0:1788796645.942081:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936207232 00000100:00100000:0.0:1788796645.942156:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:0.0:1788796645.942167:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+15:10295:x1875688936207232:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788796645.942191:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796645.942218:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e939 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.942338:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe229af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.942352:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe229af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.942364:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe229af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796645.942391:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788796645.942548:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e939 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.942569:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe229af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e939 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.942578:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:0.0:1788796645.942582:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788796645.942587:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d4600, rc 0) 00000100:00100000:0.0:1788796645.942654:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+17:10295:x1875688936207232:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 489us (771us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788796645.942681:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:2.0:1788796645.947582:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796645.947629:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796645.947705:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936207616 00000100:00100000:0.0:1788796645.947715:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936207616 00000100:00100000:0.0:1788796645.947823:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:0.0:1788796645.947833:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+17:2357:x1875688936207616:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796645.947851:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796645.947879:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe229af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e939 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.947897:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:0.0:1788796645.947902:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796645.947969:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+16:2357:x1875688936207616:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 137us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796645.947984:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:1.0:1788796645.948628:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936207488 00000100:00100000:1.0:1788796645.948637:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936207488 00000100:00100000:1.0:1788796645.948678:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:1.0:1788796645.948687:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+16:10295:x1875688936207488:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796645.948708:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796645.948725:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe229bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e940 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.948862:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe229c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.948876:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe229c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.948887:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe229c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796645.948898:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788796645.949045:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe229bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e940 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.949061:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe229c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e940 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796645.949068:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:1.0:1788796645.949082:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788796645.949085:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334e00, rc 0) 00000100:00100000:1.0:1788796645.949125:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+18:10295:x1875688936207488:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 439us (1494us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788796645.949142:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:2.0:1788796645.960383:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796645.960534:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936207744 00000100:00100000:0.0:1788796645.960545:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936207744 00000100:00100000:0.0:1788796645.960609:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:0.0:1788796645.960621:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:2355:x1875688936207744:12345-192.168.201.25@tcp:1:lfs.0 00010000:00010000:0.0:1788796645.960676:0:11435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe229d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.960696:0:11435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.960704:0:11435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796645.960708:0:11435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788796645.960728:0:11435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe229d2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.960800:0:11435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796645.960947:0:11435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 7 pid: 6692 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796645.960962:0:11435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11435:1875688959312256:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788796645.961120:0:11435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249ac0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788796645.964950:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796645.965165:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936207872 00000100:00100000:2.0:1788796645.965176:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936207872 00002000:00100000:2.0:1788796645.965226:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9bd27b4f8380 x1875688936207872/t0(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:71/0 lens 504/0 e 0 to 0 dl 1788796656 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788796645.965237:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd27b4f8380 with x1875688936207872 ext(0->12) 00010000:00010000:2.0:1788796645.965246:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 8 pid: 6692 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796645.965265:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 8 pid: 6692 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788796645.965273:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bd27b4f8380 00000100:00100000:2.0:1788796645.965315:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:2.0:1788796645.965326:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad2796a3-2145-47da-88fb-baa43721bec1+8:2357:x1875688936207872:12345-192.168.201.25@tcp:4:lfs.0 00000100:00100000:0.0:1788796645.965985:0:11435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11435:1875688959312256:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796645.966012:0:11435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe229d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788796646.019398:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ad2796a3-2145-47da-88fb-baa43721bec1 00000100:00100000:0.0:1788796646.020738:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad2796a3-2145-47da-88fb-baa43721bec1+9:2357:x1875688936207872:12345-192.168.201.25@tcp:4:lfs.0 Request processed in 55405us (55790us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788796646.020799:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00002000:00100000:0.0:1788796646.021052:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9bd27b4f8380 x1875688936207872/t4294967299(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:71/0 lens 504/448 e 0 to 0 dl 1788796656 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788796646.021065:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd27b4f8380 with x1875688936207872 ext(0->12) 00010000:00010000:0.0:1788796646.021076:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 9 pid: 6692 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.021096:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 9 pid: 6692 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788796646.021112:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bd27b4f8380 00000100:00100000:0.0:1788796646.024645:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796646.025236:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936208000 00000100:00100000:3.0:1788796646.025249:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936208000 00010000:00010000:3.0:1788796646.025297:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 9 pid: 6692 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796646.025480:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:3.0:1788796646.025493:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+9:2355:x1875688936208000:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796646.025520:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788796646.025540:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788796646.025544:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788796646 00002000:00010000:3.0:1788796646.025546:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788796646 00002000:00010000:3.0:1788796646.025548:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788796646 00010000:00010000:3.0:1788796646.025555:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 9 pid: 6692 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.025570:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 9 pid: 6692 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.025595:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22985 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e924 expref: 9 pid: 6692 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.025628:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788796646.025632:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788796646.025637:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe229d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.025646:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe229d2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.025688:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796646.025776:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+8:2355:x1875688936208000:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 285us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796646.025784:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00010000:00010000:2.0:1788796646.025955:0:11435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe229d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796646.025987:0:11435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe229d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796646.026013:0:11435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe229d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796646.026022:0:11435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe229d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796646.026030:0:11435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe229d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796646.026037:0:11435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4600 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796646.026041:0:11435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe229d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796646.026050:0:11435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe229d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796646.026063:0:11435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe229d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796646.026070:0:11435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe229d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796646.026141:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:2355:x1875688936207744:12345-192.168.201.25@tcp:1:lfs.0 Request processed in 65512us (65768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796646.026149:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:2.0:1788796646.029670:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796646.029962:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936208256 00000100:00100000:0.0:1788796646.030032:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936208256 00000100:00080000:3.0:1788796646.030122:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796646.030168:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1788796646.030179:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+18:10295:x1875688936208256:12345-192.168.201.25@tcp:35:lfs.0 00000004:00010000:0.0:1788796646.030248:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe229c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e940 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788796646.030600:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788796646.030659:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788796646.032212:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788796646.032302:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.032335:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22969 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e916 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.032346:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229d9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.033289:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22969 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e916 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.033311:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22969 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e916 expref: 22 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796646.033401:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875688959312384:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788796646.033605:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250bfea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788796646.037664:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796646.037793:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875688959312384:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796646.037832:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796646.038125:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936208384 00000100:00100000:3.0:1788796646.038144:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936208384 00010000:00010000:3.0:1788796646.038184:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22969 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e916 expref: 23 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796646.038261:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:3.0:1788796646.038272:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+23:2358:x1875688936208384:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796646.038286:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796646.038293:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22969 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e916 expref: 23 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.038305:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22969 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e916 expref: 23 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.038353:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22969 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e916 expref: 23 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.038377:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:3.0:1788796646.038383:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.038392:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.038400:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229d9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.038429:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796646.038480:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+22:2358:x1875688936208384:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 209us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796646.038487:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 37 00010000:00010000:1.0:1788796646.038602:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.038611:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788796646.038765:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788796646.038995:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788796646.039103:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959312512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788796646.039202:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796646.039236:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df36a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788796646.041502:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959312512 00000100:00100000:3.0:1788796646.041591:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959312512 00000100:00100000:3.0:1788796646.041705:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796646.041716:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875688959312512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788796646.041873:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875688959312512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 159us (2670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796646.041880:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788796646.042043:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959312512:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788796646.043294:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788796646.043678:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959312640:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788796646.043741:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796646.043927:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959312640 00000100:00100000:3.0:1788796646.043935:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959312640 00000100:00100000:3.0:1788796646.043990:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788796646.043999:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875688959312640:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788796646.044205:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1875688959312640:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 207us (463us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788796646.044213:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796646.044669:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250bfeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796646.044713:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959312640:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788796646.044888:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788796646.044941:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.044952:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229d9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.044960:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.044965:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796646.045115:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.045149:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229d9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.045166:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:0.0:1788796646.045169:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788796646.045175:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229d9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.045181:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229d9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788796646.045679:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00080000:2.0:1788796646.046594:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788796646.047111:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788796646.047137:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 373028379933ns, next at 374028376255ns, rc = 0 00000001:00080000:0.0:1788796646.047152:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788796646.048061:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:0.0:1788796646.048068:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788796646.048081:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe229c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e940 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796646.048293:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+25:10295:x1875688936208256:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 18114us (18629us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788796646.048305:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000020:00080000:0.0:1788796646.048315:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788796646.052477:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796646.052633:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936208512 00000100:00100000:0.0:1788796646.052644:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936208512 00000100:00100000:0.0:1788796646.052711:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:0.0:1788796646.052723:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+25:10295:x1875688936208512:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788796646.052795:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796646.052833:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe229e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e947 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.052907:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe229e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e947 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.052923:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe229e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e947 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.052942:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:0.0:1788796646.052945:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788796646.052949:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5000, rc 0) 00000100:00100000:0.0:1788796646.053018:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+26:10295:x1875688936208512:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 297us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796646.053025:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:0.0:1788796646.058667:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796646.058774:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936208768 00000100:00100000:3.0:1788796646.058788:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936208768 00000100:00100000:3.0:1788796646.058916:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1788796646.058927:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2504d6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+26:10295:x1875688936208768:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788796646.059279:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2504d6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+27:10295:x1875688936208768:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 352us (621us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788796646.059287:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1788796646.183478:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796646.183641:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936209024 00000100:00100000:1.0:1788796646.183653:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936209024 00000100:00100000:1.0:1788796646.183718:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:1.0:1788796646.183729:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+27:10305:x1875688936209024:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796646.183794:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796646.183817:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe229e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e94e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796646.183912:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788796646.184047:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe229e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e94e expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.184081:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1200) 00010000:00010000:1.0:1788796646.184084:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796646.184090:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe229e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e94e expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.184104:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335e00, rc 0) 00000100:00100000:1.0:1788796646.184186:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+28:10305:x1875688936209024:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 459us (718us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788796646.184194:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:1.0:1788796646.188447:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796646.188546:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936209152 00000100:00100000:0.0:1788796646.188558:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936209152 00000100:00100000:0.0:1788796646.188622:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:0.0:1788796646.188632:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+28:10305:x1875688936209152:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:0.0:1788796646.188709:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.188726:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.188738:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.188814:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe229fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.188822:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe229fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.188828:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe229fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.188920:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.188929:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.188936:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788796646.188990:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189003:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189009:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189016:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189021:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796646.189025:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189038:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189051:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:0.0:1788796646.189054:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796646.189059:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189064:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe229f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189078:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe229fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189084:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe229fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189090:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe229fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189094:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796646.189097:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe229fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189103:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe229fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189110:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd24d5f1500) 00010000:00010000:0.0:1788796646.189113:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796646.189136:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe229fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189152:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe229fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189168:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189175:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189182:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189187:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796646.189191:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189197:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189206:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:0.0:1788796646.189209:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796646.189212:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.189218:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796646.189285:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+28:10305:x1875688936209152:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 653us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796646.189293:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:2.0:1788796646.193583:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796646.193669:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936209408 00000100:00100000:0.0:1788796646.193680:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936209408 00000100:00100000:0.0:1788796646.193736:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:0.0:1788796646.193779:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+28:10305:x1875688936209408:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:0.0:1788796646.194036:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+29:10305:x1875688936209408:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 291us (464us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788796646.194044:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:3.0:1788796646.234641:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2612f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959312768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796646.234718:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796646.235046:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959312768 00000100:00100000:1.0:1788796646.235057:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959312768 00000100:00100000:1.0:1788796646.235135:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788796646.235146:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24121b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959312768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796646.235184:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796646.235250:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24121b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959312768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796646.235257:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788796646.235394:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796646.235885:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2612f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959312768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796646.257174:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796646.257366:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936209664 00000100:00100000:1.0:1788796646.257378:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936209664 00000100:00100000:1.0:1788796646.257441:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:1.0:1788796646.257452:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+29:10308:x1875688936209664:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796646.257477:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796646.257498:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22a0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e955 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.257595:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a11 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.257610:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.257621:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.257634:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22a18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.257640:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22a18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.257646:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22a18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.257814:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22a1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.257823:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.257831:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796646.257840:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788796646.257948:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.257955:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.258371:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.258378:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796646.258383:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.258392:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.258406:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796646.258410:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796646.258415:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.258421:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.258434:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22a18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.258440:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22a18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.258446:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22a18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.258450:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796646.258452:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22a18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.258468:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22a18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.258476:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd255d57200) 00010000:00010000:1.0:1788796646.258479:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796646.258482:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22a18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.258488:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22a18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.258544:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22a0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e955 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.258561:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e955 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.258569:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:1.0:1788796646.258571:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796646.258573:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334e00, rc 0) 00000100:00100000:1.0:1788796646.258786:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+31:10308:x1875688936209664:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1334us (1620us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788796646.258795:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:1.0:1788796646.262722:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796646.262937:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936209792 00000100:00100000:0.0:1788796646.262948:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936209792 00000100:00100000:0.0:1788796646.263329:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:0.0:1788796646.263341:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+31:10308:x1875688936209792:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:0.0:1788796646.263431:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.263450:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.263463:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.263490:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.263497:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.263504:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.263528:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796646.263532:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.263539:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.263551:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:0.0:1788796646.263554:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788796646.263559:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.263565:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796646.263654:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+31:10308:x1875688936209792:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 315us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796646.263663:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:3.0:1788796646.266154:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796646.266235:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936210048 00000100:00100000:1.0:1788796646.266245:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936210048 00000100:00100000:1.0:1788796646.266297:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:1.0:1788796646.266307:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+31:10308:x1875688936210048:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1788796646.266567:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+32:10308:x1875688936210048:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 260us (421us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788796646.266575:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:2.0:1788796646.514242:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796646.514348:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936210304 00000100:00100000:0.0:1788796646.514359:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936210304 00000100:00100000:0.0:1788796646.514435:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:0.0:1788796646.514446:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+32:10339:x1875688936210304:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:0.0:1788796646.514472:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796646.514493:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e95c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.514600:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.514638:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.514651:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796646.514665:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788796646.514878:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e95c expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.514897:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e95c expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.514904:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:0.0:1788796646.514907:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788796646.514910:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5200, rc 0) 00000100:00100000:0.0:1788796646.514970:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+34:10339:x1875688936210304:12345-192.168.201.25@tcp:101:cat.0 Request processed in 526us (737us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788796646.514977:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:1.0:1788796646.519472:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796646.519585:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936210560 00000100:00100000:0.0:1788796646.519596:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936210560 00000100:00100000:0.0:1788796646.519701:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:0.0:1788796646.519712:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+34:10339:x1875688936210560:12345-192.168.201.25@tcp:35:cat.0 00000100:00100000:0.0:1788796646.520054:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+35:10339:x1875688936210560:12345-192.168.201.25@tcp:35:cat.0 Request processed in 343us (592us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788796646.520063:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:2.0:1788796646.527486:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796646.527595:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936210688 00000100:00100000:0.0:1788796646.527620:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936210688 00000100:00100000:0.0:1788796646.527728:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:0.0:1788796646.527739:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd245990450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+35:2358:x1875688936210688:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796646.527804:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796646.527834:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e95c expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.527856:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:0.0:1788796646.527861:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796646.527937:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd245990450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+34:2358:x1875688936210688:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 200us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796646.527945:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:2.0:1788796646.596881:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796646.597394:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936210944 00000100:00100000:1.0:1788796646.597406:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936210944 00000100:00100000:1.0:1788796646.597479:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:1.0:1788796646.597491:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+34:10345:x1875688936210944:12345-192.168.201.25@tcp:101:dd.0 00010000:00010000:1.0:1788796646.597521:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796646.597525:0:10139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788796646.597553:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe229a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e932 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.597572:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796646.597577:0:10139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796646.597590:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22a49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e963 expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.597685:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.597699:0:10139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22a1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e955 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.597723:0:10139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.598138:0:10139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e955 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796646.598167:0:10139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22a1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e955 expref: 34 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796646.598182:0:10139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2612f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10139:1875688959312896:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788796646.599259:0:10139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27df36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796646.621959:0:10139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2612f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10139:1875688959312896:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796646.622004:0:10139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796646.622557:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796646.622621:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936211072 00000100:00100000:0.0:1788796646.622629:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936211072 00010000:00010000:0.0:1788796646.622663:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22a1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e955 expref: 35 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796646.622698:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:0.0:1788796646.622716:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+35:2358:x1875688936211072:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796646.622733:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796646.622739:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22a1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e955 expref: 35 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.622774:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e955 expref: 35 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.622797:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22a1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e955 expref: 35 pid: 5845 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.622828:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:0.0:1788796646.622833:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.622842:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.622849:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.622880:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796646.622948:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+34:2358:x1875688936211072:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 241us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796646.622955:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00010000:00010000:2.0:1788796646.623317:0:10139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796646.623326:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796646.623345:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788796646.623517:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22a49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e963 expref: 35 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796646.623545:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e963 expref: 34 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796646.623551:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:2.0:1788796646.623554:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788796646.623556:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334600, rc 0) 00000100:00100000:2.0:1788796646.623596:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+34:10345:x1875688936210944:12345-192.168.201.25@tcp:101:dd.0 Request processed in 26108us (26725us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788796646.623603:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:2.0:1788796646.634443:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796646.634586:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936211328 00000100:00100000:0.0:1788796646.634597:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936211328 00000100:00100000:0.0:1788796646.634665:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:0.0:1788796646.634678:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+34:10345:x1875688936211328:12345-192.168.201.25@tcp:36:dd.0 00010000:00010000:0.0:1788796646.635005:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.635022:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.635033:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788796646.635085:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788796646.635113:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ed2cc69 reply state 000000000f1628b6 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796646.635141:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788796646.635653:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+37:10345:x1875688936211328:12345-192.168.201.25@tcp:36:dd.0 Request processed in 556us (799us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788796646.635664:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00000020:00080000:0.0:1788796646.635669:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788796646.638225:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.638252:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.638258:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.638264:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796646.638269:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.638295:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.638322:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:3.0:1788796646.638326:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796646.638332:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.638338:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796646.749779:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796646.985592:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796646.985795:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936211456 00000100:00100000:0.0:1788796646.985817:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936211456 00000100:00100000:0.0:1788796646.985878:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:0.0:1788796646.985888:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+36:10359:x1875688936211456:12345-192.168.201.25@tcp:101:stat.0 00010000:00010000:0.0:1788796646.985914:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796646.985937:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e96a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.986001:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22a6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.986014:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22a6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.986027:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22a6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.986043:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.986049:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.986056:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.986182:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22a7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.986195:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e963 expref: 37 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.986205:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22a7a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.986249:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e963 expref: 37 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796646.986265:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e963 expref: 37 pid: 10139 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796646.986281:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959313024:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788796646.986453:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250bfe9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796646.996666:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959313024:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796646.996701:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22a7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796647.008106:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796647.008534:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936211712 00000100:00100000:3.0:1788796647.008547:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936211712 00000100:00100000:3.0:1788796647.008617:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:3.0:1788796647.008628:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+38:6057:x1875688936211712:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788796647.009459:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+39:6057:x1875688936211712:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 828us (1359us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788796647.009469:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:1.0:1788796647.015565:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796647.019592:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936211840 00000100:00100000:3.0:1788796647.019612:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936211840 00010000:00010000:3.0:1788796647.019679:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e963 expref: 39 pid: 10139 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796647.022468:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:3.0:1788796647.022499:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+39:2357:x1875688936211840:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796647.022520:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796647.022549:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e963 expref: 39 pid: 10139 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.022567:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e963 expref: 39 pid: 10139 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.022596:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22a50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e963 expref: 39 pid: 10139 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.022616:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:3.0:1788796647.022621:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22a7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.022631:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.022639:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22a7a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.023171:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796647.023256:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+38:2357:x1875688936211840:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 771us (7701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796647.023267:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00010000:00010000:1.0:1788796647.030371:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030390:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796647.030448:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788796647.030453:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796647.030509:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030525:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030535:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22a6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030541:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22a6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030548:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22a6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030554:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796647.030573:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22a6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030581:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22a6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030596:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796647.030600:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796647.030604:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22a6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030611:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22a6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030629:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030636:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030642:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030648:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796647.030650:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030655:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030662:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd24d5f1500) 00010000:00010000:1.0:1788796647.030664:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796647.030674:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.030680:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22a73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.031981:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22a65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e96a expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.032887:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22a7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e96a expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.032902:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:1.0:1788796647.032906:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796647.032911:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d4600, rc 0) 00000100:00100000:1.0:1788796647.032992:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+37:10359:x1875688936211456:12345-192.168.201.25@tcp:101:stat.0 Request processed in 47103us (47409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796647.033002:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:1.0:1788796647.151585:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796647.156873:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936212096 00000100:00100000:2.0:1788796647.156893:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936212096 00000100:00100000:2.0:1788796647.156991:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:2.0:1788796647.157003:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+37:10365:x1875688936212096:12345-192.168.201.25@tcp:36:truncate.0 00010000:00010000:2.0:1788796647.157092:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796647.157130:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22a7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e96a expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.157153:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:2.0:1788796647.157158:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788796647.157690:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.157705:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.157733:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788796647.157842:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788796647.157869:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036dab08b reply state 00000000483eccab transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796647.157879:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788796647.158015:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+39:10365:x1875688936212096:12345-192.168.201.25@tcp:36:truncate.0 Request processed in 1014us (6440us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788796647.158023:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 54 00000020:00080000:2.0:1788796647.158028:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788796647.166359:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.166383:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.166393:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.166420:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796647.166425:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.166434:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.166451:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:3.0:1788796647.166454:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796647.166460:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.166466:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796647.375821:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796647.376159:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936212224 00000100:00100000:2.0:1788796647.376170:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936212224 00000100:00100000:2.0:1788796647.376344:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:2.0:1788796647.376355:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+38:10379:x1875688936212224:12345-192.168.201.25@tcp:101:stat.0 00010000:00010000:2.0:1788796647.376395:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796647.376420:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe22a88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e971 expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376492:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22a8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376509:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22a8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376522:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22a8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376560:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe22a96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376569:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe22a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376575:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe22a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376673:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376682:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376688:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796647.376726:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788796647.376730:0:10139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788796647.376787:0:10139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376800:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376809:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22a8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376816:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22a8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376833:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22a8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376840:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7c00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796647.376844:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22a8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376853:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22a8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376866:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:2.0:1788796647.376870:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796647.376876:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22a8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376883:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22a8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376899:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe22a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376905:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe22a96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376910:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe22a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376915:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796647.376918:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe22a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376934:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe22a96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376943:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd24d573500) 00010000:00010000:2.0:1788796647.376945:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796647.376949:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe22a96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.376965:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe22a96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.377008:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe22a88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e971 expref: 40 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.377024:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e971 expref: 39 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.377031:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:2.0:1788796647.377033:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788796647.377036:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6a00, rc 0) 00000100:00100000:2.0:1788796647.377450:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+39:10379:x1875688936212224:12345-192.168.201.25@tcp:101:stat.0 Request processed in 1096us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796647.377459:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:2.0:1788796647.548145:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796647.548258:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936212480 00000100:00100000:0.0:1788796647.548269:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936212480 00000100:00100000:0.0:1788796647.548350:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:0.0:1788796647.548361:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+39:10389:x1875688936212480:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788796647.548384:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796647.548407:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22aa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e978 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796647.548515:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788796647.548646:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22aa4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e978 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.548661:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1200) 00010000:00010000:0.0:1788796647.548664:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788796647.548670:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22aa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e978 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.548686:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d4600, rc 0) 00000100:00100000:0.0:1788796647.548802:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+40:10389:x1875688936212480:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 442us (668us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788796647.548809:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:3.0:1788796647.558093:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796647.558974:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936212736 00000100:00100000:0.0:1788796647.558987:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936212736 00000100:00100000:0.0:1788796647.559058:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:0.0:1788796647.559070:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+40:10389:x1875688936212736:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:0.0:1788796647.559384:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+41:10389:x1875688936212736:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 316us (1305us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788796647.559392:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:1.0:1788796647.694876:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796647.694984:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936212992 00000100:00100000:0.0:1788796647.694996:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936212992 00000100:00100000:0.0:1788796647.695064:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:0.0:1788796647.695075:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+41:10395:x1875688936212992:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1788796647.695115:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796647.695154:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22ab2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e97f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.695275:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.695290:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e971 expref: 42 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.695299:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.695333:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e971 expref: 42 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.695347:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e971 expref: 42 pid: 10139 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796647.695363:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959313152:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788796647.695467:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250bfeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788796647.702123:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796647.702350:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936213120 00000100:00100000:3.0:1788796647.702361:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936213120 00010000:00010000:3.0:1788796647.702402:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a9d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e971 expref: 43 pid: 10139 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796647.702445:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:3.0:1788796647.702455:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+43:2358:x1875688936213120:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796647.702470:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796647.702476:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a9d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e971 expref: 43 pid: 10139 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.702490:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e971 expref: 43 pid: 10139 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.702528:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:3.0:1788796647.702533:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.702542:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.702550:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.702579:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796647.702636:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+43:2358:x1875688936213120:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 182us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796647.702644:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00010000:00010000:0.0:1788796647.703204:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22a9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e971 expref: 42 pid: 10139 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796647.703224:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959313152:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796647.703261:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.703271:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.703292:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796647.703311:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788796647.703472:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22ab2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e97f expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.703489:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e97f expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.703498:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:0.0:1788796647.703502:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788796647.703505:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d4800, rc 0) 00000100:00100000:0.0:1788796647.703551:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+42:10395:x1875688936212992:12345-192.168.201.25@tcp:101:bash.0 Request processed in 8478us (8689us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788796647.703559:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:2.0:1788796647.712223:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796647.712481:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936213376 00000100:00100000:3.0:1788796647.712492:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936213376 00000100:00100000:3.0:1788796647.712557:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:3.0:1788796647.712578:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+42:10395:x1875688936213376:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:3.0:1788796647.712882:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22ac7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.712903:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22ac7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.712916:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22ac7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788796647.712985:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788796647.713010:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080c54b1a reply state 00000000a1d96469 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22ac7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796647.713034:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788796647.713149:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+45:10395:x1875688936213376:12345-192.168.201.25@tcp:36:bash.0 Request processed in 581us (934us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788796647.713157:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 58 00000020:00080000:3.0:1788796647.713162:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788796647.723432:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22ac7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.723450:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22ac7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.723458:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22ac7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.723464:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796647.723479:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22ac7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.723487:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22ac7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.723504:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:1.0:1788796647.723507:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796647.723511:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22ac7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.723517:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22ac7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796647.723731:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796647.723835:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936213504 00000100:00100000:2.0:1788796647.723846:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936213504 00000100:00100000:2.0:1788796647.723894:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:2.0:1788796647.723904:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+44:10395:x1875688936213504:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1788796647.723928:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796647.723957:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe22ace lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e986 expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.724036:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22ad5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.724049:0:10139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e97f expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.724058:0:10139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22ad5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.724087:0:10139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e97f expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.724113:0:10139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e97f expref: 45 pid: 5846 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796647.724126:0:10139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e17ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10139:1875688959313280:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796647.724201:0:10139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249ac0300 going to sleep for 11 seconds 00000100:00100000:2.0:1788796647.729486:0:10139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e17ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10139:1875688959313280:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796647.729519:0:10139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22ad5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796647.729915:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796647.730093:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936213632 00000100:00100000:0.0:1788796647.730112:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936213632 00010000:00010000:0.0:1788796647.730151:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e97f expref: 46 pid: 5846 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796647.730187:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:0.0:1788796647.730196:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eada300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+46:2357:x1875688936213632:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796647.730212:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796647.730219:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e97f expref: 46 pid: 5846 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.730252:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e97f expref: 46 pid: 5846 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.730276:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22ab9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e97f expref: 46 pid: 5846 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.730298:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:0.0:1788796647.730304:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22ad5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.730314:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.730322:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22ad5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.730352:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796647.730406:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eada300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+45:2357:x1875688936213632:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 210us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796647.730413:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 41 00010000:00010000:2.0:1788796647.731082:0:10139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.731112:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796647.731163:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788796647.731168:0:10139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788796647.731190:0:10139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.731219:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe22ace lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e986 expref: 45 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.731237:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e986 expref: 44 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796647.731245:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:2.0:1788796647.731247:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788796647.731250:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7c00, rc 0) 00000100:00100000:2.0:1788796647.731301:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+44:10395:x1875688936213504:12345-192.168.201.25@tcp:101:bash.0 Request processed in 7398us (7573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796647.731309:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:2.0:1788796647.743254:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796647.743336:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936213888 00000100:00100000:0.0:1788796647.743351:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936213888 00000100:00100000:0.0:1788796647.743423:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:0.0:1788796647.743434:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2504d7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+44:10395:x1875688936213888:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:0.0:1788796647.743718:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2504d7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+45:10395:x1875688936213888:12345-192.168.201.25@tcp:35:bash.0 Request processed in 285us (481us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788796647.743726:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00010000:00010000:1.0:1788796647.770285:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796647.856852:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796647.856955:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936214144 00000100:00100000:3.0:1788796647.856967:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936214144 00000100:00100000:3.0:1788796647.857051:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:3.0:1788796647.857062:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+45:10405:x1875688936214144:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788796647.857094:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796647.857129:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22adc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e98d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796647.857229:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788796647.857363:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22adc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e98d expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.857379:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1200) 00010000:00010000:3.0:1788796647.857382:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788796647.857388:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22adc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e98d expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.857403:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21400, rc 0) 00000100:00100000:3.0:1788796647.857480:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+46:10405:x1875688936214144:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 420us (639us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788796647.857505:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:1.0:1788796647.861330:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796647.861665:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936214272 00000100:00100000:0.0:1788796647.861677:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936214272 00000100:00100000:0.0:1788796647.861740:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:0.0:1788796647.861784:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+46:10405:x1875688936214272:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:0.0:1788796647.861858:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22aea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.861876:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22aea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796647.861889:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22aea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.861968:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22af1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.861979:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.861988:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862079:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22af8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862087:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862093:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788796647.862159:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862173:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22aea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862179:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22aea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862185:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22aea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862191:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796647.862195:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22aea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862221:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22aea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862234:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796647.862238:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796647.862243:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22aea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862249:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22aea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862265:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862281:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22af1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862322:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862327:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334c00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796647.862330:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862337:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22af1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862345:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd255d57200) 00010000:00010000:1.0:1788796647.862348:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796647.862351:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22af1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862356:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22af1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862382:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862388:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22af8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862393:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22af8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862398:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796647.862400:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22af8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862415:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22af8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862423:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:1.0:1788796647.862426:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796647.862428:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22af8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.862433:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22af8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796647.862515:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+46:10405:x1875688936214272:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 733us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796647.862523:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:0.0:1788796647.864784:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796647.864934:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936214528 00000100:00100000:1.0:1788796647.864956:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936214528 00000100:00100000:1.0:1788796647.865043:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788796647.865055:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+46:10405:x1875688936214528:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1788796647.865367:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+47:10405:x1875688936214528:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 313us (592us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788796647.865390:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:2.0:1788796647.906994:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796647.907210:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936214784 00000100:00100000:3.0:1788796647.907220:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936214784 00000100:00100000:3.0:1788796647.907286:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:3.0:1788796647.907305:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+47:10408:x1875688936214784:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788796647.907330:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796647.907351:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22aff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e994 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.907431:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22b06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.907446:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22b06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.907457:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22b06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.907472:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22b0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.907478:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.907484:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.907596:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22b14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.907624:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22b14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.907631:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22b14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796647.907641:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788796647.907739:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22b06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.907791:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22b06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.908040:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22b06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.908047:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796647.908052:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22b06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.908059:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22b06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.908071:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:3.0:1788796647.908074:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796647.908078:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22b06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.908084:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22b06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.908108:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.908122:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22b0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.908127:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22b0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.908132:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796647.908135:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22b0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.908140:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22b0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.908147:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd24712be00) 00010000:00010000:3.0:1788796647.908150:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796647.908152:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22b0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.908157:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22b0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.908207:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22aff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e994 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.908221:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22b14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e994 expref: 49 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.908228:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:3.0:1788796647.908231:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788796647.908952:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20600, rc 0) 00000100:00100000:2.0:1788796647.909159:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+49:10408:x1875688936214784:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1853us (2171us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788796647.909169:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:2.0:1788796647.914305:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796647.914358:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796647.914510:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936214912 00000100:00100000:3.0:1788796647.914520:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936214912 00000100:00100000:3.0:1788796647.914588:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:3.0:1788796647.914599:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+49:2356:x1875688936214912:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796647.914614:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796647.914639:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22b14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e994 expref: 49 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796647.914657:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:3.0:1788796647.914662:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796647.914725:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+48:2356:x1875688936214912:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 127us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796647.914732:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:1.0:1788796647.915463:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936215040 00000100:00100000:1.0:1788796647.915470:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936215040 00000100:00100000:1.0:1788796647.915516:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:1.0:1788796647.915525:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+48:10408:x1875688936215040:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:1.0:1788796647.915581:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22b22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.915607:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.915619:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.915646:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.915652:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22b22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.915659:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22b22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.915664:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334c00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796647.915669:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22b22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.915676:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22b22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.915684:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:1.0:1788796647.915687:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796647.915690:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22b22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796647.915696:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22b22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796647.915768:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+48:10408:x1875688936215040:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 223us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796647.915779:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:1.0:1788796647.921532:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796647.921976:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936215296 00000100:00100000:0.0:1788796647.921985:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936215296 00000100:00100000:0.0:1788796647.922032:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:0.0:1788796647.922038:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+48:10408:x1875688936215296:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:0.0:1788796647.922488:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+49:10408:x1875688936215296:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 449us (966us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788796647.922494:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:0.0:1788796648.128622:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796648.128722:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936215552 00000100:00100000:2.0:1788796648.128732:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936215552 00000100:00100000:2.0:1788796648.128942:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:2.0:1788796648.128953:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+49:10426:x1875688936215552:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:2.0:1788796648.128987:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796648.129009:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22b29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e99b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.129125:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22b30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.129141:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22b30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.129156:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22b30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796648.129167:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788796648.129307:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22b29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e99b expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.129326:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22b30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e99b expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.129335:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:2.0:1788796648.129338:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788796648.129342:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6c00, rc 0) 00000100:00100000:2.0:1788796648.129426:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+51:10426:x1875688936215552:12345-192.168.201.25@tcp:101:cat.0 Request processed in 475us (963us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788796648.129451:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00080000:3.0:1788796648.134916:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796648.158977:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796648.159104:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936215680 00000100:00100000:1.0:1788796648.159114:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936215680 00000100:00100000:1.0:1788796648.159162:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:1.0:1788796648.159169:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+51:10427:x1875688936215680:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796648.159190:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796648.159208:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22b3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e9a2 expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.159284:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22b45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.159299:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.159310:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796648.159342:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788796648.159345:0:10139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796648.159358:0:10139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.159381:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22b3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9a2 expref: 53 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.159400:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22b45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9a2 expref: 52 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.159429:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796648.159432:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788796648.159436:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335c00, rc 0) 00000100:00100000:1.0:1788796648.159494:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+52:10427:x1875688936215680:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 325us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796648.159498:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:1.0:1788796648.166894:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796648.167174:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936216064 00000100:00100000:3.0:1788796648.167185:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936216064 00000100:00100000:3.0:1788796648.167252:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:3.0:1788796648.167263:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+52:10427:x1875688936216064:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788796648.167651:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+53:10427:x1875688936216064:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 389us (766us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788796648.167660:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:0.0:1788796648.173612:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796648.174256:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936216192 00000100:00100000:3.0:1788796648.174270:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936216192 00000100:00100000:3.0:1788796648.174355:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:3.0:1788796648.174368:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+53:10427:x1875688936216192:12345-192.168.201.25@tcp:103:lfs.0 00010000:00010000:3.0:1788796648.174385:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788796648.174434:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22ad5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e986 expref: 53 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.174458:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22b30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e99b expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.174473:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe229e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e947 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.174485:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:3.0:1788796648.174499:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796648.174565:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+50:10427:x1875688936216192:12345-192.168.201.25@tcp:103:lfs.0 Request processed in 200us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796648.174573:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1788796648.180259:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796648.180649:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936216320 00000100:00100000:1.0:1788796648.180660:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936216320 00000100:00100000:1.0:1788796648.180977:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 66 00000100:00100000:1.0:1788796648.180989:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+50:10427:x1875688936216320:12345-192.168.201.25@tcp:58:lfs.0 00010000:00010000:1.0:1788796648.181142:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22b4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.181157:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22b4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.181169:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22b4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788796648.181500:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788796648.181720:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788796648.181996:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788796648.182132:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+50:10427:x1875688936216320:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 1139us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796648.182142:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 66 00000100:00100000:1.0:1788796648.207385:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796648.207586:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936216448 00000100:00100000:2.0:1788796648.207597:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936216448 00000100:00100000:2.0:1788796648.207650:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:2.0:1788796648.207659:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+50:10429:x1875688936216448:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788796648.207678:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796648.207699:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22b53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e9a9 expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.207802:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22b5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.207817:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22b5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.207828:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22b5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.207843:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22b61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.207850:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.207857:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.207945:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22b68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.207960:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.207973:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796648.208007:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788796648.208011:0:10139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788796648.208030:0:10139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208040:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208048:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22b5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208055:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22b5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208062:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22b5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208068:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796648.208072:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22b5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208079:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22b5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208101:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:2.0:1788796648.208108:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796648.208114:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22b5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208121:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22b5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208134:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22b61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208140:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22b61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208147:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22b61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208151:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796648.208154:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22b61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208159:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22b61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208166:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd24d573b00) 00010000:00010000:2.0:1788796648.208168:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796648.208170:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22b61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208176:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22b61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208203:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22b53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9a9 expref: 52 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208227:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22b68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9a9 expref: 51 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.208235:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd255d57200) 00010000:00010000:2.0:1788796648.208237:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788796648.208240:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7a00, rc 0) 00000100:00100000:2.0:1788796648.208323:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+51:10429:x1875688936216448:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 664us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796648.208331:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 67 00000040:00080000:3.0:1788796648.410496:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788796648.410503:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788796648.410543:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788796648.410548:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788796648.410646:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eadad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1875688959313408:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788796648.410736:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27e459f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796648.414153:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796648.414214:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936216576 00000100:00100000:0.0:1788796648.414227:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936216576 00000100:00100000:3.0:1788796648.414436:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eadad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1875688959313408:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788796648.415025:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:0.0:1788796648.415036:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ad2796a3-2145-47da-88fb-baa43721bec1+51:10440:x1875688936216576:12345-192.168.201.25@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788796648.415131:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ad2796a3-2145-47da-88fb-baa43721bec1+51:10440:x1875688936216576:12345-192.168.201.25@tcp:900:lhsmtool_posix.0 Request processed in 96us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796648.415150:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:2.0:1788796648.423568:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796648.426456:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936216704 00000100:00100000:0.0:1788796648.426474:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936216704 00000100:00100000:0.0:1788796648.426605:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:0.0:1788796648.426616:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+51:10440:x1875688936216704:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788796648.426647:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788796648.426795:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+51:10440:x1875688936216704:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 180us (3236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796648.426803:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:2.0:1788796648.433179:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796648.434098:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936216832 00000100:00100000:1.0:1788796648.434112:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936216832 00000100:00100000:0.0:1788796648.434210:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:0.0:1788796648.434223:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+51:10440:x1875688936216832:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788796648.434311:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22b6f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434328:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22b6f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434341:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22b6f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434411:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22b76 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434420:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22b76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434427:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22b76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434471:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22b7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434480:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22b7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434487:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22b7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796648.434526:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788796648.434530:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788796648.434543:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22b7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434555:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22b6f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434561:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22b6f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434569:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22b6f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434574:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796648.434578:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22b6f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434586:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22b6f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434597:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:0.0:1788796648.434604:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796648.434609:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22b6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434615:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22b6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434630:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22b76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434636:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22b76 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434642:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22b76 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434648:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796648.434650:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22b76 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434655:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22b76 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434662:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9bd24d5f1a00) 00010000:00010000:0.0:1788796648.434664:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796648.434667:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22b76 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434673:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22b76 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434687:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22b7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434699:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22b7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434706:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22b7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434711:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796648.434714:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22b7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434720:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22b7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434727:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd255d57200) 00010000:00010000:0.0:1788796648.434729:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796648.434732:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22b7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.434737:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22b7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796648.434829:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+51:10440:x1875688936216832:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 Request processed in 608us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796648.434837:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:2.0:1788796648.437640:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796648.437731:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936217088 00000100:00100000:1.0:1788796648.437742:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936217088 00000100:00100000:1.0:1788796648.438075:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:1.0:1788796648.438096:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+51:10440:x1875688936217088:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788796648.438118:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796648.438138:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22b84 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e9b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.438230:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22b8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.438245:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22b8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.438256:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22b8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796648.438268:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788796648.438533:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22b8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.438541:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22b8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.438547:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22b8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.438553:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796648.438558:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22b8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.438581:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22b8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.438593:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd255d57200) 00010000:00010000:1.0:1788796648.438595:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788796648.438601:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22b8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.438607:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22b8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.438651:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22b84 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9b0 expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.438661:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:1.0:1788796648.438663:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796648.438667:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22b84 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9b0 expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.438676:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335400, rc 0) 00000100:00100000:1.0:1788796648.438812:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+52:10440:x1875688936217088:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 727us (1180us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788796648.438819:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:0.0:1788796648.442054:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796648.442153:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936217216 00000100:00100000:1.0:1788796648.442163:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936217216 00000100:00100000:1.0:1788796648.442252:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00100000:1.0:1788796648.442264:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+52:10440:x1875688936217216:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788796648.442460:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788796648.442605:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+52:10440:x1875688936217216:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 343us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796648.442613:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00100000:2.0:1788796648.445647:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796648.446077:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936217472 00000100:00100000:3.0:1788796648.446388:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936217472 00000100:00100000:3.0:1788796648.446494:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 72 00000100:00100000:3.0:1788796648.446505:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+52:10440:x1875688936217472:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788796648.446531:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796648.446534:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788796648.446574:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22b45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9a2 expref: 52 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.446595:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:3.0:1788796648.446600:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788796648.446616:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22b99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e9b7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788796648.447554:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788796648.448128:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22ba0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.448149:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.448165:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.448244:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22b99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9b7 expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.448264:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9b7 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.448273:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd24712be00) 00010000:00010000:3.0:1788796648.448276:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788796648.448288:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21400, rc 0) 00000100:00100000:3.0:1788796648.448360:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+53:10440:x1875688936217472:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1857us (2724us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788796648.448517:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 72 00000100:00100000:2.0:1788796648.451443:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796648.451592:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936217728 00000100:00100000:3.0:1788796648.451603:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936217728 00000100:00100000:3.0:1788796648.451790:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00100000:3.0:1788796648.451801:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+53:10440:x1875688936217728:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788796648.451860:0:10139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796648.451889:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22ba0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9b7 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.451909:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd24712be00) 00010000:00010000:3.0:1788796648.451920:0:10139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788796648.451952:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22bae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.451976:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22bae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.451987:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22bae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452129:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x765217ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452139:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x765217ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452161:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x765217ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452392:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22bae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452401:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22bae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452408:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22bae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452414:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796648.452418:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22bae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452426:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22bae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452433:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:0.0:1788796648.452435:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796648.452438:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22bae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452442:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22bae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452450:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x765217ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452454:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x765217ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452463:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x765217ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452467:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796648.452469:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x765217ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452473:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x765217ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452477:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x765217ac (ffff9bd24d5f1a00) 00010000:00010000:0.0:1788796648.452478:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796648.452480:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x765217ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.452483:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x765217ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796648.452554:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+52:10440:x1875688936217728:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 755us (1121us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788796648.452562:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00100000:0.0:1788796648.456112:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796648.456173:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936217856 00000100:00100000:2.0:1788796648.456186:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936217856 00000100:00100000:2.0:1788796648.456288:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:2.0:1788796648.456299:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+52:10440:x1875688936217856:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788796648.456319:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796648.456344:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe22bbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e9be expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.456384:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22bc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.456421:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.456433:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.456543:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe22bbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9be expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.456561:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22bc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9be expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.456569:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd24d573b00) 00010000:00010000:2.0:1788796648.456572:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788796648.456576:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7600, rc 0) 00000100:00100000:2.0:1788796648.456648:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+53:10440:x1875688936217856:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 350us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796648.456655:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:0.0:1788796648.460527:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796648.460630:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936218112 00000100:00100000:1.0:1788796648.460708:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936218112 00000100:00100000:0.0:1788796648.461154:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:0.0:1788796648.461167:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+53:10440:x1875688936218112:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788796648.461261:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22bca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.461483:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22bca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.461496:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22bca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788796648.462201:0:10139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1788796648.462213:0:10139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375443466361ns, next at 376443463291ns, rc = 0 00000004:00010000:0.0:1788796648.462388:0:10139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008591e43a reply state 000000005c80a733 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22bca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796648.462397:0:10139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788796648.462555:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+55:10440:x1875688936218112:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 1389us (2039us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788796648.462564:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:1.0:1788796648.465598:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796648.465910:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936218240 00000100:00100000:0.0:1788796648.465920:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936218240 00000100:00100000:0.0:1788796648.465995:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 76 00000100:00100000:0.0:1788796648.466005:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+55:10440:x1875688936218240:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788796648.466028:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796648.466050:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e9c5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.466121:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9c5 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.466137:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9c5 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.466181:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd24d573b00) 00010000:00010000:0.0:1788796648.466184:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788796648.466187:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d4600, rc 0) 00000100:00100000:0.0:1788796648.466249:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+56:10440:x1875688936218240:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 245us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796648.466256:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 76 00010000:00010000:3.0:1788796648.469473:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22bca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.469491:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22bca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.469499:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22bca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.469527:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796648.469532:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22bca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.469540:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22bca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.469557:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd24d573b00) 00010000:00010000:3.0:1788796648.469560:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788796648.469564:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22bca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.469571:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22bca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796648.470374:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796648.471158:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936218368 00000100:00100000:3.0:1788796648.471169:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936218368 00000100:00100000:3.0:1788796648.471213:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:3.0:1788796648.471221:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1875688936218368:12345-192.168.201.25@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788796648.471253:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp t0 exp 0000000000000000 cur 375 last 0 00000020:00000080:3.0:1788796648.471292:0:6691:0:(genops.c:1384:class_connect()) connect: client ad2796a3-2145-47da-88fb-baa43721bec1, cookie 0xdd273c88cfe22bd8 00002000:00100000:3.0:1788796648.471304:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ad2796a3-2145-47da-88fb-baa43721bec1/ffff9bd250d2d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788796648.471329:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788796648.471567:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788796648.471600:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9bd250d29000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788796648.471980:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2354:x1875688936218368:12345-192.168.201.25@tcp:8:lhsmtool_posix.0 Request processed in 756us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796648.472006:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:1.0:1788796648.478451:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796648.478790:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936218496 00000100:00100000:2.0:1788796648.478801:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936218496 00000100:00100000:2.0:1788796648.478875:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:2.0:1788796648.478887:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:0:x1875688936218496:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788796648.479127:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788796648.569418:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1788796648.569450:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad2796a3-2145-47da-88fb-baa43721bec1 00000100:00100000:2.0:1788796648.569587:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:0:x1875688936218496:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 90696us (91141us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788796648.569617:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:0.0:1788796648.580597:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796648.580685:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936218752 00000100:00100000:1.0:1788796648.580696:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936218752 00000100:00100000:1.0:1788796648.580781:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:1.0:1788796648.580792:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+55:10440:x1875688936218752:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788796648.581047:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+56:10440:x1875688936218752:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 256us (461us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788796648.581055:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:0.0:1788796648.595686:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796648.595781:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936219008 00000100:00100000:1.0:1788796648.595791:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936219008 00000100:00100000:1.0:1788796648.595847:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:1.0:1788796648.595857:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+56:10440:x1875688936219008:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788796648.595980:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+56:10440:x1875688936219008:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 124us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796648.595988:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:1.0:1788796648.609557:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796648.610031:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936219136 00000100:00100000:3.0:1788796648.610043:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936219136 00000100:00100000:3.0:1788796648.613105:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:3.0:1788796648.613124:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+56:10440:x1875688936219136:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788796648.613147:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796648.613170:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22bdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e9cc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.613239:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22be6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.613261:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.613271:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796648.613315:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788796648.613334:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.613359:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22bdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9cc expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.613375:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22be6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9cc expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.613384:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd24d573b00) 00010000:00010000:3.0:1788796648.613396:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788796648.613401:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20600, rc 0) 00000100:00100000:3.0:1788796648.613470:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+57:10440:x1875688936219136:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 352us (3923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796648.613477:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:1.0:1788796648.629994:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796648.630148:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936219264 00000100:00100000:3.0:1788796648.630159:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936219264 00000100:00100000:3.0:1788796648.630218:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:3.0:1788796648.630228:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+5:2358:x1875688936219264:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788796648.630255:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796648.630285:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052f9af0a/0xdd273c88cfe22bed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e9d3 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788796648.630314:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9edee9, blocks: 0x1 00010000:00010000:3.0:1788796648.630333:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1788796648.630337:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796648.630346:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052f9af0a/0xdd273c88cfe22bed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9d3 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.630366:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000052f9af0a/0xdd273c88cfe22bed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9d3 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.630379:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21000, rc 0) 00000100:00100000:3.0:1788796648.630440:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2358:x1875688936219264:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 214us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796648.630447:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:3.0:1788796648.645895:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796648.646090:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936219520 00000100:00100000:1.0:1788796648.646102:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936219520 00000100:00100000:1.0:1788796648.646177:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:1.0:1788796648.646188:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+57:10440:x1875688936219520:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788796648.646309:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+57:10440:x1875688936219520:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 122us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796648.646316:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:3.0:1788796648.651228:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796648.651497:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936219648 00000100:00100000:2.0:1788796648.651508:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936219648 00000100:00100000:2.0:1788796648.651568:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:2.0:1788796648.651579:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+6:10440:x1875688936219648:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788796648.651597:0:11435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796648.651615:0:11435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007caef970/0xdd273c88cfe22bf4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e9da expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.651649:0:11435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000052f9af0a/0xdd273c88cfe22bed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9d3 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.651659:0:11435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796648.651663:0:11435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796648.651668:0:11435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caef970/0xdd273c88cfe22bf4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9da expref: 7 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.651700:0:11435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000052f9af0a/0xdd273c88cfe22bed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9d3 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.651714:0:11435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000052f9af0a/0xdd273c88cfe22bed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9d3 expref: 7 pid: 6691 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796648.651727:0:11435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11435:1875688959313536:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796648.651837:0:11435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2671edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796648.654888:0:11435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11435:1875688959313536:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788796648.654923:0:11435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007caef970/0xdd273c88cfe22bf4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9da expref: 7 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796648.655078:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796648.655534:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936219776 00000100:00100000:0.0:1788796648.655545:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936219776 00010000:00010000:0.0:1788796648.655583:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000052f9af0a/0xdd273c88cfe22bed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9d3 expref: 8 pid: 6691 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796648.655625:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:0.0:1788796648.655635:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd245990050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+8:2358:x1875688936219776:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796648.655650:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796648.655671:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000052f9af0a/0xdd273c88cfe22bed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9d3 expref: 8 pid: 6691 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.655683:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000052f9af0a/0xdd273c88cfe22bed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9d3 expref: 8 pid: 6691 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.655704:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052f9af0a/0xdd273c88cfe22bed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9d3 expref: 8 pid: 6691 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.655733:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796648.655737:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796648.655772:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007caef970/0xdd273c88cfe22bf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9da expref: 7 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.655782:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007caef970/0xdd273c88cfe22bf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9da expref: 7 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.655821:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007caef970/0xdd273c88cfe22bf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9da expref: 7 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796648.655836:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a37480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1875688959313664:192.168.201.25@tcp:105: 00000100:00100000:0.0:1788796648.655911:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2467e36c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788796648.656046:0:11435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6200, rc 0) 00000100:00100000:3.0:1788796648.656078:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:10440:x1875688936219648:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 4501us (4859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796648.656096:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:3.0:1788796648.667849:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796648.667896:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936219904 00000100:00100000:3.0:1788796648.667905:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936219904 00002000:00100000:3.0:1788796648.667955:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9bd27eadb100 x1875688936219904/t0(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:74/0 lens 504/0 e 0 to 0 dl 1788796659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788796648.667965:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd27eadb100 with x1875688936219904 ext(0->8) 00002000:00010000:3.0:1788796648.667971:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd27eadb100 00000100:00100000:3.0:1788796648.667998:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:3.0:1788796648.668007:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936219904:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788796648.671696:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad2796a3-2145-47da-88fb-baa43721bec1+9:2358:x1875688936219904:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 Request processed in 3679us (3849us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788796648.671709:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00002000:00100000:3.0:1788796648.671721:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9bd27eadb100 x1875688936219904/t4294967302(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:74/0 lens 504/448 e 0 to 0 dl 1788796659 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788796648.671730:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd27eadb100 with x1875688936219904 ext(0->8) 00002000:00010000:3.0:1788796648.671762:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd27eadb100 00000100:00100000:3.0:1788796648.671922:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a37480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1875688959313664:192.168.201.25@tcp:105: 00010000:00010000:3.0:1788796648.671947:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796648.671975:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd245990050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+8:2358:x1875688936219776:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 16341us (16898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796648.671985:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:1.0:1788796648.690459:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796648.690501:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936220032 00000100:00100000:1.0:1788796648.690511:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936220032 00000100:00100000:1.0:1788796648.690565:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:1.0:1788796648.690575:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+57:10440:x1875688936220032:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788796648.794054:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1788796648.794067:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1788796648.794114:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788796648.794134:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd250bfe540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788796648.794139:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd245ec8000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd250bfea80 00000020:00080000:2.0:1788796648.794143:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd247c65100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd2467b4000 00000001:00080000:2.0:1788796648.794164:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:2.0:1788796648.794340:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788796648.794360:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959313792:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788796648.794425:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788796648.794638:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796648.794711:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959313792 00000100:00100000:3.0:1788796648.794719:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959313792 00000100:00100000:3.0:1788796648.794865:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788796648.794874:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875688959313792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788796648.794901:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788796648.795002:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9edee6, atime: 0x6a9edee6, ctime: 0x6a9edee6, blocks: 0x1 00010000:00010000:3.0:1788796648.795011:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe22bfb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.795026:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1788796648.795031:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796648.795036:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe22bfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.795051:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe22bfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.795060:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe22bfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.795067:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe22bfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.795110:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788796648.795651:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1875688959313792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 777us (1224us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788796648.795659:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788796648.795685:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788796648.795720:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd2671cc700/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788796648.795725:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959313792:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788796648.795880:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796648.795886:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe22bfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.795895:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21200 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796648.795900:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe22bfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.795909:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe22bfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.796208:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe22bfb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.796218:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe22bfb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.796247:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796648.796249:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796648.796251:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796648.796567:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+13:10440:x1875688936220032:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 Request processed in 105990us (106117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796648.796576:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:2.0:1788796648.797344:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959313920:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788796648.797397:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788796648.798130:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788796648.798253:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788796648.799152:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959313920 00000100:00100000:0.0:1788796648.799165:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959313920 00000100:00100000:0.0:1788796648.799280:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788796648.799291:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959313920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788796648.799479:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788796648.799483:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788796649 00002000:00010000:0.0:1788796648.799485:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788796648.799487:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788796649 -> 1788796649 00002000:00010000:0.0:1788796648.799489:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788796648.799561:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875688959313920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 272us (2163us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788796648.799569:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1788796648.799804:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd27eada300/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788796648.799812:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959313920:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1788796648.800031:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796648.801499:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796648.801670:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936220160 00000100:00100000:1.0:1788796648.801680:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936220160 00000100:00100000:1.0:1788796648.801727:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:1.0:1788796648.801737:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+8:2357:x1875688936220160:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788796648.844358:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+8:2357:x1875688936220160:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 Request processed in 42611us (42853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796648.844372:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 30 00000001:00080000:1.0:1788796648.844413:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788796648.844423:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1788796648.851416:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796648.851739:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936220416 00000100:00100000:1.0:1788796648.851789:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936220416 00000100:00100000:1.0:1788796648.851851:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:1.0:1788796648.851861:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+13:10440:x1875688936220416:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788796648.851916:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796648.851967:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22be6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9cc expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.851988:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd24d573b00) 00010000:00010000:1.0:1788796648.851994:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796648.852042:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22c02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.852057:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.852068:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788796648.852351:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3ed2f7f reply state 0000000066db9937 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796648.852361:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788796648.852473:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+14:10440:x1875688936220416:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 613us (1067us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788796648.852479:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:1.0:1788796648.856008:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796648.856100:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936220544 00000100:00100000:2.0:1788796648.856111:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936220544 00000100:00100000:2.0:1788796648.856173:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:2.0:1788796648.856184:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2357:x1875688936220544:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788796648.856440:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788796648.856444:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788796649 -> 1788796648 00002000:00010000:2.0:1788796648.856447:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788796646 00002000:00010000:2.0:1788796648.856449:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788796649 -> 1788796648 00002000:00010000:2.0:1788796648.856452:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788796648.856507:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936220544:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 325us (509us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788796648.856515:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 31 00010000:00010000:3.0:1788796648.857250:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.857261:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22c02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.857269:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22c02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.857286:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796648.857292:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22c02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.857299:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22c02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.857334:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd24d573b00) 00010000:00010000:3.0:1788796648.857338:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796648.857343:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22c02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.857352:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22c02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796648.859614:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796648.859714:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936220800 00000100:00100000:2.0:1788796648.859724:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936220800 00000100:00100000:2.0:1788796648.859967:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:2.0:1788796648.859978:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+13:10440:x1875688936220800:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788796648.860055:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22c09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.860094:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22bc3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9be expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.860104:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22c09 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.860139:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22bc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9be expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.860155:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22bc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9be expref: 13 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796648.860169:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959314048:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796648.860433:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83780 going to sleep for 11 seconds 00000100:00100000:3.0:1788796648.865603:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796648.865723:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959314048:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796648.865930:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22c09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796648.866177:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936220928 00000100:00100000:0.0:1788796648.866185:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936220928 00010000:00010000:0.0:1788796648.866230:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22bc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9be expref: 14 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796648.866407:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:0.0:1788796648.866418:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+14:2357:x1875688936220928:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796648.866433:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796648.866441:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22bc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9be expref: 14 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.866455:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22bc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9be expref: 14 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.866479:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22bc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9be expref: 14 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.866495:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd24d573b00) 00010000:00010000:0.0:1788796648.866500:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22c09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.866510:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.866518:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22c09 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.866552:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796648.866634:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+13:2357:x1875688936220928:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 217us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796648.866642:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00010000:00010000:1.0:1788796648.867936:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.867949:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.867979:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.868002:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22c09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.868009:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22c09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.868014:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6c00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796648.868018:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22c09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.868026:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22c09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.868040:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd24d573b00) 00010000:00010000:1.0:1788796648.868043:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788796648.868048:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22c09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796648.868053:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22c09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796648.868144:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+12:10440:x1875688936220800:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 Request processed in 8165us (8538us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788796648.868155:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:1.0:1788796648.876508:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796648.876716:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936221056 00000100:00100000:0.0:1788796648.876728:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936221056 00000100:00100000:0.0:1788796648.876812:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:0.0:1788796648.876823:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936221056:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788796648.876866:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22c10 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.876887:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007caef970/0xdd273c88cfe22bf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9da expref: 7 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.876895:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796648.876898:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788796648.876903:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22c10 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.876936:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007caef970/0xdd273c88cfe22bf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9da expref: 7 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.876950:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007caef970/0xdd273c88cfe22bf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9da expref: 7 pid: 11435 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796648.876965:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875688959314176:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788796648.877052:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2467e3480 going to sleep for 11 seconds 00000100:00100000:0.0:1788796648.884039:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875688959314176:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796648.884070:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22c10 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796648.887149:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796648.887769:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936221184 00000100:00100000:0.0:1788796648.887783:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936221184 00010000:00010000:0.0:1788796648.887828:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007caef970/0xdd273c88cfe22bf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9da expref: 8 pid: 11435 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796648.887874:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:0.0:1788796648.887884:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+8:2358:x1875688936221184:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796648.887899:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796648.888124:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007caef970/0xdd273c88cfe22bf4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9da expref: 8 pid: 11435 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.888142:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007caef970/0xdd273c88cfe22bf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9da expref: 8 pid: 11435 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.888170:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007caef970/0xdd273c88cfe22bf4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9da expref: 8 pid: 11435 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.888189:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788796648.888197:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788796648.888203:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22c10 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.888228:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22c10 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.888301:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796648.888356:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936221184:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 473us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796648.888364:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00010000:00010000:3.0:1788796648.893909:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22c10 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.894589:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22c10 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.894629:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22c10 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.894639:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22c10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.894647:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22c10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.894654:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5000 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796648.894659:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22c10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.894683:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22c10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.894707:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22c10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.894715:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22c10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796648.894953:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2358:x1875688936221056:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 Request processed in 18127us (18446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796648.894963:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:1.0:1788796648.899893:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796648.902309:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936221440 00000100:00100000:2.0:1788796648.902324:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936221440 00000100:00100000:2.0:1788796648.902400:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00100000:2.0:1788796648.902411:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+12:10440:x1875688936221440:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788796648.902493:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.902510:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.902533:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.902794:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c1e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.902806:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bd1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9c5 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.902814:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c1e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.902850:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9c5 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.902865:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bd1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9c5 expref: 13 pid: 5844 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796648.902880:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875688959314304:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796648.902969:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83780 going to sleep for 11 seconds 00000100:00100000:3.0:1788796648.910030:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796648.910164:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936221568 00000100:00100000:2.0:1788796648.910175:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936221568 00010000:00010000:2.0:1788796648.910215:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bd1 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9c5 expref: 14 pid: 5844 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796648.910256:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:2.0:1788796648.910267:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+14:2357:x1875688936221568:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796648.910283:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796648.910297:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bd1 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9c5 expref: 14 pid: 5844 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.910311:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bd1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9c5 expref: 14 pid: 5844 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.910336:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd24d573b00) 00010000:00010000:2.0:1788796648.910342:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c1e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.910352:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.910361:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c1e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.910382:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796648.910436:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+14:2357:x1875688936221568:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 170us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796648.910444:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00010000:00010000:2.0:1788796648.910571:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22bd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9c5 expref: 13 pid: 5844 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796648.910587:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875688959314304:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796648.910610:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.910619:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.910636:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788796648.910855:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788796648.910966:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788796648.910997:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788796648.911073:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875688959314432:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788796648.911144:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796648.911179:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83900 going to sleep for 11 seconds 00000100:00100000:3.0:1788796648.911394:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959314432 00000100:00100000:3.0:1788796648.911400:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959314432 00000100:00100000:3.0:1788796648.911442:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788796648.911451:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875688959314432:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788796648.911518:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875688959314432:12345-0@lo:1000:mdt00_001.0 Request processed in 68us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796648.911524:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788796648.913135:0:5845:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788796648.913146:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd27eada300, transno 4294967303 00000100:00100000:2.0:1788796648.913198:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875688959314432:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788796648.913769:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788796648.913858:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875688959314560:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788796648.913913:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796648.913960:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83780 going to sleep for 11 seconds 00000100:00100000:2.0:1788796648.913986:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959314560 00000100:00100000:2.0:1788796648.913992:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959314560 00000100:00100000:2.0:1788796648.914030:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788796648.914038:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875688959314560:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788796648.914225:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1875688959314560:12345-0@lo:1000:mdt00_001.0 Request processed in 186us (311us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788796648.914232:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788796648.914270:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875688959314560:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788796648.914304:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914324:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c1e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914332:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c1e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914338:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796648.914343:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c1e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914350:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c1e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914366:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd24d573b00) 00010000:00010000:2.0:1788796648.914369:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788796648.914374:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c1e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914381:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c1e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914415:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22b4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914421:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22b4c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914427:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22b4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914432:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796648.914439:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22b4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914446:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22b4c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914453:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd255d57200) 00010000:00010000:2.0:1788796648.914455:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788796648.914458:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22b4c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914463:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22b4c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914481:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22c25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914493:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22b68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9a9 expref: 16 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914502:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22c25 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914523:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22b68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9a9 expref: 16 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.914535:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22b68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9a9 expref: 16 pid: 10139 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796648.914545:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875688959314688:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796648.914601:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250bfe9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796648.917252:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796648.917350:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875688959314688:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796648.917390:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22c25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796648.917446:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936221696 00000100:00100000:0.0:1788796648.917454:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936221696 00010000:00010000:0.0:1788796648.917493:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22b68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9a9 expref: 17 pid: 10139 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796648.917530:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:0.0:1788796648.917540:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+17:2358:x1875688936221696:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796648.917554:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796648.917561:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22b68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9a9 expref: 17 pid: 10139 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.917573:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22b68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9a9 expref: 17 pid: 10139 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.917598:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22b68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9a9 expref: 17 pid: 10139 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.917614:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd255d57200) 00010000:00010000:0.0:1788796648.917625:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22c25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.917635:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22c25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.917642:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22c25 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.917673:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796648.917723:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+16:2358:x1875688936221696:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 184us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796648.917730:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00010000:00010000:3.0:1788796648.918309:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22c25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.918319:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22c25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.918339:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22c25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.918347:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22c25 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.918353:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22c25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.918359:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796648.918364:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22c25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.918383:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22c25 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.918395:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd255d57200) 00010000:00010000:3.0:1788796648.918398:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796648.918402:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22c25 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.918408:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22c25 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.918419:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.918425:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.918431:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.918441:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7c00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796648.918444:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.918449:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.918456:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd255d57200) 00010000:00010000:3.0:1788796648.918458:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788796648.918461:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796648.918466:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788796648.919651:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788796648.919659:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788796648.919689:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788796648.919697:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788796648.919806:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+15:10440:x1875688936221440:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 17392us (19922us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788796648.919817:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 83 00000020:00080000:3.0:1788796648.919823:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788796648.923712:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796648.923880:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936221952 00000100:00100000:0.0:1788796648.923891:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936221952 00000100:00100000:0.0:1788796648.923950:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:0.0:1788796648.923960:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+15:10440:x1875688936221952:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788796648.925530:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788796648.925667:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788796648.925734:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22c2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.925937:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22c2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.925953:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22c2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.925971:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22c2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.925978:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22c2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.925984:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22c2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796648.926035:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788796648.926184:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+17:10440:x1875688936221952:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 2222us (2479us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788796648.926195:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000020:00080000:0.0:1788796648.926200:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788796648.926242:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796648.926250:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22c2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.926256:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5e00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796648.926260:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22c2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.926268:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22c2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.926281:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bd24d5f1400) 00010000:00010000:2.0:1788796648.926285:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788796648.926290:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22c2c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.926296:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22c2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796648.926313:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796648.926315:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796648.926317:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788796649.057012:0:12010:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788796649.057022:0:12010:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788796649.057103:0:12010:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788796649.057109:0:12010:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788796649.246766:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796649.249058:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936222208 00000100:00100000:1.0:1788796649.249084:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936222208 00000100:00100000:1.0:1788796649.249151:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:1.0:1788796649.249161:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+17:10450:x1875688936222208:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796649.249185:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796649.249217:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22c33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e9e1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.249317:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22c3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.249331:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22c3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.249345:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22c3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796649.249357:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788796649.249475:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22c33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9e1 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.249492:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22c3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9e1 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.249502:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796649.249505:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788796649.249508:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334c00, rc 0) 00000100:00100000:1.0:1788796649.249577:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+19:10450:x1875688936222208:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 418us (2837us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788796649.249591:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:0.0:1788796649.254973:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796649.255045:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936222336 00000100:00100000:2.0:1788796649.255056:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936222336 00000100:00100000:2.0:1788796649.255122:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:2.0:1788796649.255131:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+19:10450:x1875688936222336:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:2.0:1788796649.255218:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255242:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255256:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255274:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe22c4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255281:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe22c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255287:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe22c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255516:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255525:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255532:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788796649.255578:0:10139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255591:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255597:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255613:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255619:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796649.255623:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255631:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255643:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:2.0:1788796649.255647:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796649.255652:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255658:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22c48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255668:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe22c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255674:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe22c4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255679:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe22c4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255683:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796649.255686:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe22c4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255701:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe22c4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255709:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd24d573b00) 00010000:00010000:2.0:1788796649.255711:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796649.255714:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe22c4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255719:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe22c4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255733:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255739:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255770:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.255776:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7c00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796649.256008:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.256017:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.256025:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d573e00) 00010000:00010000:2.0:1788796649.256028:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796649.256031:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.256047:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe22c56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796649.256148:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+19:10450:x1875688936222336:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 1015us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796649.256157:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:1.0:1788796649.306116:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959315072:0@lo:400:kworker.0 00000100:00100000:3.0:1788796649.306129:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959314944:0@lo:400:kworker.0 00000100:00100000:0.0:1788796649.306223:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959314816:0@lo:400:kworker.0 00000100:00100000:2.0:1788796649.306916:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959315200:0@lo:400:kworker.0 00000100:00100000:3.0:1788796649.309800:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796649.309876:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959315456:0@lo:400:kworker.0 00000100:00100000:3.0:1788796649.310691:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796649.311965:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796649.312105:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796649.312142:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875688959315328:0@lo:400:kworker.0 00000100:00100000:0.0:1788796649.312192:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796649.312350:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959314944 00000100:00100000:1.0:1788796649.312359:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959314944 00000100:00100000:1.0:1788796649.312432:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959315072 00000100:00100000:1.0:1788796649.312436:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959315072 00000100:00100000:0.0:1788796649.315382:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959314816 00000100:00100000:0.0:1788796649.315394:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959314816 00000100:00100000:0.0:1788796649.315452:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788796649.315461:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3304:x1875688959314816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796649.315549:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3304:x1875688959314816:12345-0@lo:400:kworker.0 Request processed in 89us (3444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796649.315556:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788796649.315609:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959314816:0@lo:400:kworker.0 00000100:00100000:2.0:1788796649.316007:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959315328 00000100:00100000:2.0:1788796649.316013:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959315328 00000100:00100000:2.0:1788796649.316043:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788796649.316050:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959314944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796649.316113:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959314944:12345-0@lo:400:kworker.0 Request processed in 63us (6321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796649.316119:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788796649.316134:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788796649.316141:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959315072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796649.316181:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959315072:12345-0@lo:400:kworker.0 Request processed in 41us (4219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796649.316186:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788796649.316213:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788796649.316219:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875688959315328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796649.316252:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875688959315328:12345-0@lo:400:kworker.0 Request processed in 34us (4059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796649.316257:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788796649.316415:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875688959315328:0@lo:400:kworker.0 00000100:00100000:0.0:1788796649.316445:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959314944:0@lo:400:kworker.0 00000100:00100000:2.0:1788796649.319621:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959315456 00000100:00100000:2.0:1788796649.319646:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959315456 00000100:00100000:2.0:1788796649.319698:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788796649.319708:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1875688959315456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796649.319830:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1875688959315456:12345-0@lo:400:kworker.0 Request processed in 123us (9141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796649.319836:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788796649.319880:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796649.320178:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959315456:0@lo:400:kworker.0 00000100:00100000:2.0:1788796649.320235:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796649.320268:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959315200 00000100:00100000:2.0:1788796649.320272:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959315200 00000100:00100000:2.0:1788796649.320298:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788796649.320305:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d50ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875688959315200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796649.320355:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d50ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875688959315200:12345-0@lo:400:kworker.0 Request processed in 50us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796649.320361:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788796649.320416:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796649.320631:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959315200:0@lo:400:kworker.0 00000100:00100000:0.0:1788796649.333942:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936222592 00000100:00100000:0.0:1788796649.333958:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936222592 00000100:00100000:0.0:1788796649.334023:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:0.0:1788796649.334033:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+19:10453:x1875688936222592:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788796649.334055:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796649.334087:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe22c5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e9e8 expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334158:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22c64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334172:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22c64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334184:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22c64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334267:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334277:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334285:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334565:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22c72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334579:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334586:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796649.334597:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788796649.334700:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22c64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334709:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22c64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334715:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22c64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334721:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796649.334725:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22c64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334732:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22c64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334766:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:0.0:1788796649.334769:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796649.334774:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22c64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334849:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22c64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334864:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334877:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334882:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334888:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796649.334891:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334897:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334906:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd24d5f1a00) 00010000:00010000:0.0:1788796649.334908:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796649.334911:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334917:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334962:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe22c5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9e8 expref: 22 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334977:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9e8 expref: 21 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.334985:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1b00) 00010000:00010000:0.0:1788796649.334988:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788796649.334996:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5200, rc 0) 00000100:00100000:0.0:1788796649.335068:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+21:10453:x1875688936222592:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1035us (14652us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788796649.335085:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:1.0:1788796649.336652:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959315072:0@lo:400:kworker.0 00000100:00100000:1.0:1788796649.340363:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796649.340396:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936222720 00000100:00100000:1.0:1788796649.340405:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936222720 00000100:00100000:1.0:1788796649.340459:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:1.0:1788796649.340470:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+21:10453:x1875688936222720:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:1.0:1788796649.340536:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22c80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.340555:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22c80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.340568:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22c80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.340600:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22c80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.340608:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22c80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.340615:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22c80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.340628:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796649.340633:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22c80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.340641:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22c80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.340653:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1b00) 00010000:00010000:1.0:1788796649.340657:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796649.340662:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22c80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.340670:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22c80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796649.340741:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+21:10453:x1875688936222720:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 272us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796649.340765:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:1.0:1788796649.345207:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796649.350924:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936222976 00000100:00100000:2.0:1788796649.350940:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936222976 00000100:00100000:2.0:1788796649.351003:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:2.0:1788796649.351013:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2504d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+21:10453:x1875688936222976:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788796649.351270:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2504d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+22:10453:x1875688936222976:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 256us (6069us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788796649.351277:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:3.0:1788796649.436994:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796649.438281:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936223232 00000100:00100000:0.0:1788796649.438294:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936223232 00000100:00100000:0.0:1788796649.438413:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 88 00000100:00100000:0.0:1788796649.438424:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+22:9982:x1875688936223232:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1788796649.438449:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796649.438470:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe22c87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e9ef expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.438583:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.438598:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22c72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9e8 expref: 23 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.438618:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.438654:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9e8 expref: 23 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.438678:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22c72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9e8 expref: 23 pid: 10139 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796649.438692:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267305180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875688959315584:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788796649.438810:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd241254600 going to sleep for 11 seconds 00000100:00100000:3.0:1788796649.446023:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796649.446219:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936223360 00000100:00100000:2.0:1788796649.446229:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936223360 00010000:00010000:2.0:1788796649.446272:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22c72 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9e8 expref: 24 pid: 10139 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796649.446331:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:2.0:1788796649.446342:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+24:2358:x1875688936223360:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796649.446359:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796649.446366:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22c72 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9e8 expref: 24 pid: 10139 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.446379:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22c72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9e8 expref: 24 pid: 10139 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.446402:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1b00) 00010000:00010000:2.0:1788796649.446407:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.446416:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.446423:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.446443:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796649.446517:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+24:2358:x1875688936223360:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 176us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796649.446524:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00010000:00010000:0.0:1788796649.447099:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22c72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9e8 expref: 23 pid: 10139 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796649.447119:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267305180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875688959315584:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796649.447138:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.447147:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.447153:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796649.447174:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788796649.447469:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe22c87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9ef expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.447486:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9ef expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.447494:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1b00) 00010000:00010000:0.0:1788796649.447497:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788796649.447500:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d4800, rc 0) 00000100:00100000:0.0:1788796649.447590:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+23:9982:x1875688936223232:12345-192.168.201.25@tcp:101:bash.0 Request processed in 9168us (10607us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788796649.447597:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 88 00000100:00100000:3.0:1788796649.457289:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796649.459485:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936223616 00000100:00100000:1.0:1788796649.459501:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936223616 00000100:00100000:1.0:1788796649.459571:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 89 00000100:00100000:1.0:1788796649.459581:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+23:9982:x1875688936223616:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:1.0:1788796649.459907:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22c9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.459925:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22c9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.459955:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22c9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788796649.460007:0:10139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788796649.460033:0:10139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e1c8027 reply state 000000004784e83e transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22c9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796649.460041:0:10139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788796649.460099:0:10139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788796649.460335:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+27:9982:x1875688936223616:12345-192.168.201.25@tcp:36:bash.0 Request processed in 754us (3056us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788796649.460343:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 89 00000020:00080000:1.0:1788796649.460347:0:10139:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788796649.465579:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22c9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.465597:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22c9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.465606:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22c9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.465612:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796649.465616:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22c9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.465624:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22c9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.465641:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1b00) 00010000:00010000:3.0:1788796649.465644:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796649.465649:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22c9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.465655:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22c9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796649.466180:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796649.470496:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936223744 00000100:00100000:3.0:1788796649.470515:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936223744 00000100:00100000:3.0:1788796649.470585:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:3.0:1788796649.470597:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+26:9982:x1875688936223744:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788796649.470623:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796649.470663:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe22ca3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e9f6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.470732:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe22ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9f6 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.470778:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe22ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9f6 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.470799:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1b00) 00010000:00010000:3.0:1788796649.470803:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788796649.470806:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20000, rc 0) 00000100:00100000:3.0:1788796649.470873:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+27:9982:x1875688936223744:12345-192.168.201.25@tcp:101:bash.0 Request processed in 278us (4696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796649.470880:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:2.0:1788796649.475378:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796649.475538:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936223872 00000100:00100000:0.0:1788796649.475571:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936223872 00000100:00100000:0.0:1788796649.475638:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:0.0:1788796649.475648:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:9982:x1875688936223872:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1788796649.475667:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796649.475689:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22caa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65e9fd expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788796649.475719:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9edee8, atime: 0x6a9edee6, ctime: 0x6a9edee8, blocks: 0xb 00010000:00010000:0.0:1788796649.475783:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788796649.475789:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796649.475798:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22caa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9fd expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.475818:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22caa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9fd expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.475832:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5000, rc 0) 00000100:00100000:0.0:1788796649.476066:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+7:9982:x1875688936223872:12345-192.168.201.25@tcp:101:bash.0 Request processed in 242us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796649.476084:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:1.0:1788796649.477844:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796649.483689:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936224000 00000100:00100000:0.0:1788796649.483706:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936224000 00002000:00010000:2.0:1788796649.483925:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788796649.483931:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd247d64700 with x1875688936224000 ext(0->18446744073709551615) 00002000:00010000:2.0:1788796649.483945:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd247d64700. 00000100:00100000:2.0:1788796649.484211:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:2.0:1788796649.484224:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936224000:12345-192.168.201.25@tcp:10:bash.0 00002000:00010000:2.0:1788796649.484513:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788796649.484517:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788796648 -> 1788796650 00002000:00010000:2.0:1788796649.484520:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788796646 -> 1788796646 00002000:00010000:2.0:1788796649.484522:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788796648 -> 1788796650 00002000:00010000:2.0:1788796649.484524:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788796649.484601:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad2796a3-2145-47da-88fb-baa43721bec1+8:2358:x1875688936224000:12345-192.168.201.25@tcp:10:bash.0 Request processed in 379us (6765us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788796649.484610:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00002000:00010000:2.0:1788796649.484614:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788796649.484617:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd247d64700 with x1875688936224000 ext(0->18446744073709551615) 00002000:00010000:2.0:1788796649.484622:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd247d64700. 00000100:00100000:1.0:1788796649.591943:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796649.592007:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936224128 00000100:00100000:3.0:1788796649.592018:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936224128 00000100:00100000:3.0:1788796649.592092:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 91 00000100:00100000:3.0:1788796649.592104:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+27:10467:x1875688936224128:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:3.0:1788796649.592380:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22cb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.592398:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.592409:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.592426:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22cb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.592448:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.592455:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604423:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22cbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604453:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22cbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604468:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22cbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788796649.604543:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22cbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604558:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604565:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22cb1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604589:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22cb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604594:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796649.604598:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22cb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604606:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22cb1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604620:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:2.0:1788796649.604624:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796649.604629:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22cb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604636:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe22cb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604653:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604660:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22cb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604666:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604672:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796649.604675:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604691:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22cb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604699:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd24712be00) 00010000:00010000:2.0:1788796649.604701:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796649.604704:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22cb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604709:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe22cb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604727:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22cbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604733:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22cbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604739:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22cbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604837:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796649.604841:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22cbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604846:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22cbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604853:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1b00) 00010000:00010000:2.0:1788796649.604856:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796649.604858:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22cbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.604873:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22cbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796649.605025:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+27:10467:x1875688936224128:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 12919us (13087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796649.605035:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 91 00000100:00100000:3.0:1788796649.668678:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796649.668825:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936224384 00000100:00100000:1.0:1788796649.668835:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936224384 00000100:00100000:1.0:1788796649.668891:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 92 00000100:00100000:1.0:1788796649.668901:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+27:10470:x1875688936224384:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796649.668920:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796649.668939:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22cc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea04 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669017:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ccd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669032:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ccd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669057:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ccd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669087:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22cd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669096:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669103:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669560:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22cdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669571:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669578:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796649.669588:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788796649.669667:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ccd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669675:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ccd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669682:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ccd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669688:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796649.669698:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ccd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669706:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ccd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669718:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796649.669721:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796649.669725:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ccd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669732:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ccd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669919:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669927:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22cd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669934:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669939:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796649.669942:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669948:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22cd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669957:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd255d57c00) 00010000:00010000:1.0:1788796649.669959:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796649.669969:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22cd4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.669975:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22cd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.670029:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22cc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea04 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.670043:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22cdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea04 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.670051:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1b00) 00010000:00010000:1.0:1788796649.670054:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788796649.670056:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334e00, rc 0) 00000100:00100000:1.0:1788796649.670123:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+29:10470:x1875688936224384:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1223us (1453us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788796649.670254:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 92 00000100:00100000:1.0:1788796649.677780:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796649.677880:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936224512 00000100:00100000:0.0:1788796649.677892:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936224512 00000100:00100000:0.0:1788796649.677951:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 93 00000100:00100000:0.0:1788796649.677961:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+29:10470:x1875688936224512:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:0.0:1788796649.678343:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22ce9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.678375:0:10139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9ef expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.678385:0:10139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22ce9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.678421:0:10139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9ef expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.678435:0:10139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9ef expref: 29 pid: 5845 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796649.678451:0:10139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267305180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10139:1875688959315712:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788796649.678557:0:10139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd241254600 going to sleep for 11 seconds 00000100:00100000:0.0:1788796649.680646:0:10139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267305180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10139:1875688959315712:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796649.680671:0:10139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22ce9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796649.683889:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796649.683980:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936224768 00000100:00100000:2.0:1788796649.683990:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936224768 00000100:00100000:2.0:1788796649.684045:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:2.0:1788796649.684054:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+30:6057:x1875688936224768:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788796649.684370:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+31:6057:x1875688936224768:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 316us (489us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788796649.684379:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:3.0:1788796649.689909:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796649.690199:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936224896 00000100:00100000:0.0:1788796649.690212:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936224896 00010000:00010000:0.0:1788796649.690262:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9ef expref: 31 pid: 5845 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796649.690314:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:0.0:1788796649.690324:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+31:2358:x1875688936224896:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796649.690343:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796649.690367:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9ef expref: 31 pid: 5845 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.690383:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9ef expref: 31 pid: 5845 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.690406:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22c8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9ef expref: 31 pid: 5845 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.690423:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1b00) 00010000:00010000:0.0:1788796649.690428:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22ce9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.690438:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.690445:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22ce9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.690471:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796649.690613:0:10139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.690623:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.690655:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.690662:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22ce9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.690677:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.690682:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796649.690687:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.690694:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22ce9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.690703:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1b00) 00010000:00010000:1.0:1788796649.690706:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796649.690710:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22ce9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.690716:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22ce9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796649.690822:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+30:10470:x1875688936224512:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 12861us (13077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796649.690831:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 93 00000100:00100000:1.0:1788796649.692016:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+29:2358:x1875688936224896:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 1678us (2103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796649.692027:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:3.0:1788796649.693880:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796649.693987:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936225152 00000100:00100000:2.0:1788796649.693997:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936225152 00000100:00100000:2.0:1788796649.694056:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:2.0:1788796649.694073:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+29:10470:x1875688936225152:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788796649.694286:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+30:10470:x1875688936225152:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 221us (412us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788796649.694294:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:2.0:1788796649.803735:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796649.803834:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936225408 00000100:00100000:0.0:1788796649.803845:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936225408 00000100:00100000:0.0:1788796649.803910:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:0.0:1788796649.803920:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+30:10481:x1875688936225408:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:0.0:1788796649.803945:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796649.803965:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22cf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea0b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804036:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22cf7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804077:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804089:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804107:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22cfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804115:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804122:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804521:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22d05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804531:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804539:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796649.804550:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788796649.804638:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804647:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22cf7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804654:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22cf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804666:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796649.804671:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22cf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804679:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22cf7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804692:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:0.0:1788796649.804695:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796649.804699:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22cf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804706:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22cf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804718:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804724:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22cfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804731:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22cfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804736:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796649.804738:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22cfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804795:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22cfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804813:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd24d5f1300) 00010000:00010000:0.0:1788796649.804816:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796649.804819:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22cfe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804825:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22cfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804867:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22cf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea0b expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804881:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22d05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea0b expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796649.804889:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1b00) 00010000:00010000:0.0:1788796649.804891:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788796649.804894:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5e00, rc 0) 00000100:00100000:0.0:1788796649.805439:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+32:10481:x1875688936225408:12345-192.168.201.25@tcp:101:cat.0 Request processed in 1518us (1711us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788796649.805447:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 94 00010000:00010000:2.0:1788796649.817964:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796649.818374:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959315840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796649.818445:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796649.818646:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959315840 00000100:00100000:3.0:1788796649.818656:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959315840 00000100:00100000:3.0:1788796649.818709:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788796649.818718:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959315840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788796649.818775:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796649.818822:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959315840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796649.818830:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788796649.819564:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959315840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796649.819852:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796649.819918:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936225664 00000100:00100000:2.0:1788796649.819937:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936225664 00000100:00100000:2.0:1788796649.819978:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:2.0:1788796649.819986:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+32:10481:x1875688936225664:12345-192.168.201.25@tcp:35:cat.0 00000100:00100000:2.0:1788796649.820319:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+33:10481:x1875688936225664:12345-192.168.201.25@tcp:35:cat.0 Request processed in 333us (468us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788796649.820326:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:3.0:1788796649.844545:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796649.844805:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936225920 00000100:00100000:2.0:1788796649.844816:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936225920 00000100:00100000:2.0:1788796649.844878:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 95 00000100:00100000:2.0:1788796649.844888:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+33:10482:x1875688936225920:12345-192.168.201.25@tcp:36:rm.0 00010000:00010000:2.0:1788796649.844947:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788796649.844974:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22d05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea0b expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.845000:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22cdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea04 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.845015:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe22ca3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9f6 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.845027:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d5f1b00) 00010000:00010000:2.0:1788796649.845038:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788796649.845059:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22d13 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.845102:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22d13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.845143:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22d13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.845164:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22d1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.845173:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22d1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.845180:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22d1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.845678:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22d21 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.845687:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22d21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.845694:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22d21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788796649.847711:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788796649.847721:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376828974283ns, next at 377828972168ns, rc = 0 00010000:00010000:2.0:1788796649.847797:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22d28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.847808:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.847816:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.847830:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22d28 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.847834:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22d28 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.847838:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22d28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.847855:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788796649.847881:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22d21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.847887:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22d21 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.847894:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22d21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.847897:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796649.847899:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796649.847903:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22d21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.847912:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22d28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.847912:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22d21 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.847924:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6a00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796649.847926:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d573b00) 00010000:00010000:2.0:1788796649.847928:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788796649.847932:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22d28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.847933:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22d21 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.847940:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22d28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.847950:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe22d21 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.847957:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bd24d573b00) 00010000:00010000:3.0:1788796649.847959:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788796649.847962:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22d28 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.847967:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe22d28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.847968:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22d13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.847974:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22d13 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.847980:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22d13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.847985:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796649.847988:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22d13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.847990:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796649.847992:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796649.847994:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796649.847994:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22d13 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.848002:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:2.0:1788796649.848004:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796649.848008:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22d13 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.848014:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe22d13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788796649.848022:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c2001e4 reply state 00000000e0c27e5d transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22d1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796649.848030:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788796649.848259:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+32:10482:x1875688936225920:12345-192.168.201.25@tcp:36:rm.0 Request processed in 3368us (3718us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788796649.848268:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 95 00010000:00010000:1.0:1788796649.854905:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22d1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.854943:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22d1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.854952:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22d1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.854959:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796649.854964:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22d1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.854972:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22d1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.854988:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd24d573e00) 00010000:00010000:1.0:1788796649.854991:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796649.854995:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22d1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.855002:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe22d1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796649.864182:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796649.864422:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796649.864449:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796649.864543:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936226048 00000100:00100000:1.0:1788796649.864554:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936226048 00000100:00100000:1.0:1788796649.864607:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 291 00000100:00100000:1.0:1788796649.864616:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2356:x1875688936226048:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796649.864688:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2356:x1875688936226048:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 72us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796649.864695:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 291 00000100:00100000:3.0:1788796649.865099:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796649.865209:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936226432 00000100:00100000:1.0:1788796649.865226:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936226432 00000100:00100000:1.0:1788796649.865280:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 144 00000100:00100000:1.0:1788796649.865288:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936226432:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796649.865329:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936226432:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 42us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796649.865335:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 144 00000100:00080000:3.0:1788796649.867300:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796649.870736:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936226304 00000100:00100000:0.0:1788796649.870763:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936226304 00000100:00100000:0.0:1788796649.870914:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936226176 00000100:00100000:0.0:1788796649.870919:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936226176 00000100:00100000:0.0:1788796649.870948:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:0.0:1788796649.870958:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:2356:x1875688936226304:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796649.871051:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:2356:x1875688936226304:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 94us (6628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796649.871086:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:0.0:1788796649.871104:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:0.0:1788796649.871111:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+8:2356:x1875688936226176:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796649.871139:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+8:2356:x1875688936226176:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 28us (6688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796649.871145:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00080000:3.0:1788796649.873998:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788796649.906335:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796649.906490:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936226688 00000100:00100000:1.0:1788796649.906503:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936226688 00000100:00100000:1.0:1788796649.906563:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:1.0:1788796649.906575:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+31:10489:x1875688936226688:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796649.906604:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796649.906626:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22d2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea12 expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.906789:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22d36 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.906804:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22d36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.906816:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22d36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.906832:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22d3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.906838:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.906844:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788796649.907413:0:10139:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788796649.907577:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22d44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.907587:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22d44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.907596:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22d44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.907629:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22d36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.907636:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22d36 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.907642:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22d36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.907649:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796649.907653:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22d36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.907660:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22d36 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.907673:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796649.907676:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796649.907682:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22d36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.907699:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22d36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788796649.907712:0:10139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011631774 reply state 00000000c29b9d65 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796649.907720:0:10139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788796649.907786:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22d2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea12 expref: 34 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.907800:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22d44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea12 expref: 33 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.907807:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57000) 00010000:00010000:1.0:1788796649.907809:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796649.907811:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335200, rc 0) 00000100:00100000:1.0:1788796649.907881:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+34:10489:x1875688936226688:12345-192.168.201.25@tcp:101:bash.0 Request processed in 1308us (1556us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788796649.907888:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:0.0:1788796649.915200:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796649.915274:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936226816 00000100:00100000:2.0:1788796649.915283:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936226816 00000100:00100000:2.0:1788796649.915339:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:2.0:1788796649.915349:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936226816:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1788796649.915365:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796649.915385:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e60342c0/0xdd273c88cfe22d52 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea19 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788796649.915411:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788796649.915431:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1788796649.915436:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796649.915446:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e60342c0/0xdd273c88cfe22d52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea19 expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.915465:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e60342c0/0xdd273c88cfe22d52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea19 expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.915477:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7000, rc 0) 00000100:00100000:2.0:1788796649.915540:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+8:2357:x1875688936226816:12345-192.168.201.25@tcp:101:bash.0 Request processed in 192us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796649.915548:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 34 00010000:00010000:3.0:1788796649.923430:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.923448:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22d3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.923456:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22d3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.923462:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335c00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796649.923466:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22d3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.923497:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22d3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.923514:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd255d57c00) 00010000:00010000:3.0:1788796649.923517:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796649.923522:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22d3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796649.923528:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22d3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796649.928261:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796649.928411:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936226944 00000100:00100000:1.0:1788796649.928422:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936226944 00000100:00100000:1.0:1788796649.928480:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:1.0:1788796649.928491:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+8:10489:x1875688936226944:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796649.928510:0:11435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796649.928531:0:11435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea20 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.928584:0:11435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e60342c0/0xdd273c88cfe22d52 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea19 expref: 9 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.928595:0:11435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796649.928600:0:11435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796649.928605:0:11435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 9 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.928636:0:11435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e60342c0/0xdd273c88cfe22d52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea19 expref: 9 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796649.928651:0:11435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e60342c0/0xdd273c88cfe22d52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea19 expref: 9 pid: 6692 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796649.928665:0:11435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11435:1875688959315968:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788796649.928798:0:11435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2527600c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796649.933540:0:11435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11435:1875688959315968:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796649.933579:0:11435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 9 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.933616:0:11435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335e00, rc 0) 00000100:00100000:2.0:1788796649.933680:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+9:10489:x1875688936226944:12345-192.168.201.25@tcp:101:bash.0 Request processed in 5190us (5426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796649.933689:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:0.0:1788796649.938007:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796649.938104:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936227072 00000100:00100000:2.0:1788796649.938114:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936227072 00010000:00010000:2.0:1788796649.938154:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e60342c0/0xdd273c88cfe22d52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea19 expref: 9 pid: 6692 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796649.938210:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:2.0:1788796649.938220:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd245993850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+9:2357:x1875688936227072:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796649.938235:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796649.938260:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e60342c0/0xdd273c88cfe22d52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea19 expref: 9 pid: 6692 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.938274:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e60342c0/0xdd273c88cfe22d52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea19 expref: 9 pid: 6692 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.938299:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e60342c0/0xdd273c88cfe22d52 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea19 expref: 9 pid: 6692 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.938316:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796649.938321:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796649.938328:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 8 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.938351:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 8 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796649.938392:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 8 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796649.938406:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1875688959316096:192.168.201.25@tcp:105: 00000100:00100000:2.0:1788796649.938487:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796649.944260:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1875688959316096:192.168.201.25@tcp:105: 00010000:00010000:2.0:1788796649.944286:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796649.944336:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd245993850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+8:2357:x1875688936227072:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 6117us (6338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796649.944347:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:0.0:1788796649.947709:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796649.947855:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936227328 00000100:00100000:2.0:1788796649.947865:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936227328 00000100:00100000:2.0:1788796649.947921:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:2.0:1788796649.947932:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+33:10489:x1875688936227328:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:2.0:1788796649.948323:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+34:10489:x1875688936227328:12345-192.168.201.25@tcp:35:bash.0 Request processed in 390us (623us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788796649.948330:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:0.0:1788796650.105904:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796650.106072:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936227456 00000100:00100000:1.0:1788796650.106084:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936227456 00000100:00100000:1.0:1788796650.106221:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00100000:1.0:1788796650.106240:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+34:10505:x1875688936227456:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796650.106275:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796650.106298:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22d60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea27 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.106366:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22d67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.106395:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.106409:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796650.106445:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788796650.106449:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796650.106467:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.106507:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22d60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea27 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.106529:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea27 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.106538:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796650.106541:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788796650.106546:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334400, rc 0) 00000100:00100000:1.0:1788796650.106616:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+35:10505:x1875688936227456:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 386us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796650.106623:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00080000:3.0:1788796650.113911:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796650.114688:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796650.114794:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936227712 00000100:00100000:1.0:1788796650.114806:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936227712 00000100:00100000:1.0:1788796650.114871:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 98 00000100:00100000:1.0:1788796650.114881:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+35:10505:x1875688936227712:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796650.114916:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796650.114952:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22d6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea2e expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.115135:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22d75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.115151:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.115166:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796650.115178:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788796650.115535:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22d6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea2e expref: 38 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.115554:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22d75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea2e expref: 37 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.115563:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57000) 00010000:00010000:1.0:1788796650.115567:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796650.115570:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334600, rc 0) 00000100:00100000:1.0:1788796650.115636:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+37:10505:x1875688936227712:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 757us (954us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788796650.115644:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 98 00000100:00100000:2.0:1788796650.129539:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796650.129581:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796650.129825:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936228096 00000100:00100000:3.0:1788796650.129834:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936228096 00000100:00100000:3.0:1788796650.129913:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:3.0:1788796650.129922:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+37:2356:x1875688936228096:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796650.129938:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796650.129965:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22d75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea2e expref: 37 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796650.129985:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57000) 00010000:00010000:3.0:1788796650.129990:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796650.130050:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+36:2356:x1875688936228096:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 128us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796650.130069:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:1.0:1788796650.130304:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936227968 00000100:00100000:1.0:1788796650.130309:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936227968 00000100:00100000:1.0:1788796650.130351:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:1.0:1788796650.130359:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+36:10505:x1875688936227968:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796650.130396:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796650.130410:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22d83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea35 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.130500:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22d8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.130515:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22d8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.130526:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22d8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796650.130539:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788796650.130658:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22d83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea35 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.130675:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22d8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea35 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.130683:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57000) 00010000:00010000:1.0:1788796650.130686:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788796650.130688:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334e00, rc 0) 00000100:00100000:1.0:1788796650.130726:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+38:10505:x1875688936227968:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 367us (1196us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788796650.130732:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:0.0:1788796650.138465:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796650.138560:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936228224 00000100:00100000:2.0:1788796650.138574:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936228224 00000100:00100000:2.0:1788796650.138652:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:2.0:1788796650.138663:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+8:2357:x1875688936228224:12345-192.168.201.25@tcp:1:lfs.0 00010000:00010000:2.0:1788796650.138718:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22d98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.138740:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 8 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.138794:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788796650.138799:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788796650.138804:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22d98 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.138839:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 8 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.138854:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 8 pid: 11435 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796650.138868:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1875688959316224:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796650.139028:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83780 going to sleep for 11 seconds 00000100:00100000:0.0:1788796650.143909:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796650.144259:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936228352 00000100:00100000:3.0:1788796650.144284:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936228352 00002000:00100000:3.0:1788796650.144339:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9bd267305880 x1875688936228352/t0(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:76/0 lens 504/0 e 0 to 0 dl 1788796661 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788796650.144351:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd267305880 with x1875688936228352 ext(0->8) 00010000:00010000:3.0:1788796650.144361:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 9 pid: 11435 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796650.144381:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 9 pid: 11435 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788796650.144390:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bd267305880 00000100:00100000:3.0:1788796650.144427:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:3.0:1788796650.144436:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad2796a3-2145-47da-88fb-baa43721bec1+9:2357:x1875688936228352:12345-192.168.201.25@tcp:4:lfs.0 00000100:00100000:3.0:1788796650.144993:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad2796a3-2145-47da-88fb-baa43721bec1+11:2357:x1875688936228352:12345-192.168.201.25@tcp:4:lfs.0 Request processed in 555us (1097us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788796650.145002:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00002000:00100000:3.0:1788796650.145010:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9bd267305880 x1875688936228352/t4294967302(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:76/0 lens 504/448 e 0 to 0 dl 1788796661 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788796650.145019:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd267305880 with x1875688936228352 ext(0->8) 00010000:00010000:3.0:1788796650.145025:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 11 pid: 11435 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796650.145039:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 11 pid: 11435 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788796650.145071:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bd267305880 00000100:00100000:2.0:1788796650.145778:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1875688959316224:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796650.145807:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22d98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796650.149644:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796650.149871:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936228480 00000100:00100000:0.0:1788796650.149883:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936228480 00010000:00010000:0.0:1788796650.150157:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 11 pid: 11435 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796650.150256:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:0.0:1788796650.150267:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+11:2358:x1875688936228480:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796650.150281:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788796650.150300:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788796650.150303:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788796650 00002000:00010000:0.0:1788796650.150306:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788796650 00002000:00010000:0.0:1788796650.150308:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788796650 00010000:00010000:0.0:1788796650.150326:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 11 pid: 11435 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.150341:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 11 pid: 11435 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.150366:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe22d59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea20 expref: 11 pid: 11435 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.150382:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788796650.150387:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788796650.150392:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22d98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.150403:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22d98 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.150436:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796650.150489:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+10:2358:x1875688936228480:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 223us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796650.150496:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 50 00010000:00010000:1.0:1788796650.151033:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22d98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.151073:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22d98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.151102:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22d98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.151110:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22d98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.151118:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22d98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.151125:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7a00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:1.0:1788796650.151129:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22d98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.151138:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22d98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.151153:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22d98 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.151161:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe22d98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796650.151245:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+9:2357:x1875688936228224:12345-192.168.201.25@tcp:1:lfs.0 Request processed in 12583us (12789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796650.151254:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:3.0:1788796650.155036:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796650.155210:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936228736 00000100:00100000:2.0:1788796650.155425:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936228736 00000100:00100000:2.0:1788796650.155487:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:2.0:1788796650.155498:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2504d4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+38:10505:x1875688936228736:12345-192.168.201.25@tcp:35:lfs.0 00000004:00010000:2.0:1788796650.155570:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22d8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea35 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788796650.156546:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788796650.156614:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788796650.157530:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788796650.157592:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22d9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.157611:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22d44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea12 expref: 42 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.157621:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22d9f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.157655:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22d44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea12 expref: 42 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.157670:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22d44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea12 expref: 42 pid: 10139 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796650.157684:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671cf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875688959316352:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796650.157965:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83780 going to sleep for 11 seconds 00000100:00100000:2.0:1788796650.162334:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796650.162695:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671cf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875688959316352:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796650.162723:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22d9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796650.163873:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936228864 00000100:00100000:2.0:1788796650.163884:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936228864 00010000:00010000:2.0:1788796650.163957:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22d44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea12 expref: 43 pid: 10139 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796650.163998:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:2.0:1788796650.164007:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+43:2358:x1875688936228864:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796650.164021:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796650.164027:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22d44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea12 expref: 43 pid: 10139 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.164039:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22d44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea12 expref: 43 pid: 10139 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.164140:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22d44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea12 expref: 43 pid: 10139 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.164158:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57000) 00010000:00010000:2.0:1788796650.164163:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22d9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.164171:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.164179:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22d9f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.164201:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796650.164282:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+42:2358:x1875688936228864:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 265us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796650.164289:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00010000:00010000:0.0:1788796650.164835:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.164854:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788796650.164991:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788796650.165232:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788796650.165376:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267306a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959316480:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788796650.165438:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796650.165471:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd243f7a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796650.168717:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959316480 00000100:00100000:3.0:1788796650.168733:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959316480 00000100:00100000:3.0:1788796650.168833:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788796650.168843:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5848:x1875688959316480:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788796650.168965:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5848:x1875688959316480:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 123us (3526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796650.168972:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788796650.169064:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788796650.169111:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267306a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959316480:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788796650.169618:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788796650.169709:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267306a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959316608:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788796650.169778:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796650.169802:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2504dee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788796650.169932:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959316608 00000100:00100000:3.0:1788796650.169938:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959316608 00000100:00100000:3.0:1788796650.169980:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788796650.169987:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5848:x1875688959316608:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788796650.170146:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5848:x1875688959316608:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 159us (367us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788796650.170153:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788796650.170372:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267306a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959316608:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788796650.170427:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788796650.170470:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.170479:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22d9f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.170488:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22d9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.170493:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796650.170497:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22d9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.170518:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22d9f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.170534:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57000) 00010000:00010000:0.0:1788796650.170538:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788796650.170543:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22d9f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.170550:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22d9f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788796650.170725:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788796650.171350:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788796650.171364:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377152617471ns, next at 378152614578ns, rc = 0 00000001:00080000:0.0:1788796650.171373:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788796650.171607:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57000) 00010000:00010000:0.0:1788796650.171611:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788796650.171620:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22d8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea35 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796650.174124:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2504d4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+45:10505:x1875688936228736:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 18617us (19087us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788796650.174140:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 26 00000020:00080000:0.0:1788796650.174147:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788796650.178374:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796650.180425:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936228992 00000100:00100000:1.0:1788796650.180440:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936228992 00000100:00100000:1.0:1788796650.180618:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:1.0:1788796650.180630:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+45:10505:x1875688936228992:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796650.180657:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796650.180682:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22da6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea3c expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.180771:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22da6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea3c expref: 46 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.180789:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22da6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea3c expref: 46 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.180810:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:1.0:1788796650.180813:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788796650.180817:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335e00, rc 0) 00000100:00100000:1.0:1788796650.180903:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+46:10505:x1875688936228992:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 262us (2522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796650.180910:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:3.0:1788796650.184844:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796650.184955:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936229248 00000100:00100000:0.0:1788796650.184965:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936229248 00000100:00100000:0.0:1788796650.185027:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:0.0:1788796650.185039:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+46:10505:x1875688936229248:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:0.0:1788796650.185292:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+47:10505:x1875688936229248:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 255us (457us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788796650.185300:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:3.0:1788796650.323736:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796650.324229:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936229376 00000100:00100000:1.0:1788796650.324242:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936229376 00000100:00100000:1.0:1788796650.324323:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:1.0:1788796650.324333:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+47:10515:x1875688936229376:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:1.0:1788796650.324413:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22dad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324429:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22dad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324440:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22dad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324457:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22db4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324463:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324471:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324558:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22dbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324566:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22dbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324574:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22dbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788796650.324615:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22dbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324627:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22dad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324640:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22dad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324647:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22dad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324653:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796650.324658:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22dad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324666:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22dad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324677:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796650.324679:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796650.324684:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22dad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324690:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22dad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324703:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324709:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22db4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324714:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22db4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324719:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796650.324729:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22db4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324735:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22db4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324742:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd255d57400) 00010000:00010000:1.0:1788796650.324797:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796650.324801:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22db4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324808:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22db4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324825:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22dbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324831:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22dbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324836:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22dbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324841:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796650.324843:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22dbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324848:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22dbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324855:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:1.0:1788796650.324857:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796650.324866:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22dbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.324871:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22dbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796650.327837:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+47:10515:x1875688936229376:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 3492us (4097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796650.327849:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:1.0:1788796650.373162:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796650.373244:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936229632 00000100:00100000:2.0:1788796650.373254:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936229632 00000100:00100000:2.0:1788796650.373308:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 102 00000100:00100000:2.0:1788796650.373319:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+47:10518:x1875688936229632:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788796650.373339:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796650.373360:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe22dc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea43 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373432:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe22dc9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373447:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe22dc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373459:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe22dc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373474:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22dd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373481:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373488:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373605:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22dd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373613:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373636:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796650.373646:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788796650.373739:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe22dc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373785:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe22dc9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373792:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe22dc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373798:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796650.373802:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe22dc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373810:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe22dc9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373821:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:2.0:1788796650.373824:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796650.373828:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe22dc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373835:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe22dc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373848:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373853:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22dd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373865:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22dd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373870:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796650.373874:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22dd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373900:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22dd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373909:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd24d573d00) 00010000:00010000:2.0:1788796650.373911:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796650.373914:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22dd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373920:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe22dd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373960:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe22dc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea43 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373975:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea43 expref: 49 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.373982:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:2.0:1788796650.373984:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788796650.373987:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6c00, rc 0) 00000100:00100000:2.0:1788796650.374073:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+49:10518:x1875688936229632:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 755us (920us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788796650.374091:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 102 00000100:00100000:3.0:1788796650.381850:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796650.382214:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936229760 00000100:00100000:0.0:1788796650.382226:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936229760 00000100:00100000:0.0:1788796650.382279:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 103 00000100:00100000:0.0:1788796650.382289:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+49:10518:x1875688936229760:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:0.0:1788796650.382354:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22de5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.382371:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.382382:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.382407:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.382414:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22de5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.382422:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.382428:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796650.382432:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.382439:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22de5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.382465:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:0.0:1788796650.382468:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788796650.382473:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22de5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.382480:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22de5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796650.382548:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+49:10518:x1875688936229760:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 260us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796650.382555:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 103 00000100:00100000:3.0:1788796650.384804:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796650.385187:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936230016 00000100:00100000:0.0:1788796650.385198:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936230016 00000100:00100000:0.0:1788796650.385249:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:0.0:1788796650.385259:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+49:10518:x1875688936230016:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:0.0:1788796650.385499:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+50:10518:x1875688936230016:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 241us (753us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788796650.385507:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:2.0:1788796650.493423:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796650.493535:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936230272 00000100:00100000:1.0:1788796650.493547:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936230272 00000100:00100000:1.0:1788796650.493610:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00100000:1.0:1788796650.493621:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+50:10528:x1875688936230272:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796650.493645:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796650.493648:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788796650.493674:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22d67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea27 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.493693:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796650.493699:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796650.493714:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22dec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea4a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.493882:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22df3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.494004:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.494026:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796650.494037:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788796650.494177:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22dec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea4a expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.494192:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22df3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea4a expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.494199:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:1.0:1788796650.494201:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796650.494204:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335a00, rc 0) 00000100:00100000:1.0:1788796650.494301:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+51:10528:x1875688936230272:12345-192.168.201.25@tcp:101:bash.0 Request processed in 681us (887us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788796650.494308:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00100000:3.0:1788796650.514256:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796650.514426:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936230528 00000100:00100000:0.0:1788796650.514436:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936230528 00000100:00100000:0.0:1788796650.514499:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 105 00000100:00100000:0.0:1788796650.514510:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+51:10528:x1875688936230528:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:0.0:1788796650.514571:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788796650.514599:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22df3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea4a expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.514623:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe22dd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea43 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.514649:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:0.0:1788796650.514656:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788796650.515109:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22e01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.515124:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.515135:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788796650.515192:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788796650.515222:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004675f506 reply state 000000007cf305e6 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796650.515232:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788796650.518991:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+52:10528:x1875688936230528:12345-192.168.201.25@tcp:36:bash.0 Request processed in 4468us (4731us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788796650.519004:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 105 00000020:00080000:0.0:1788796650.519011:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788796650.535130:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.535146:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22e01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.535154:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22e01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.535160:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796650.535165:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22e01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.535189:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22e01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.535205:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:1.0:1788796650.535209:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796650.535214:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22e01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.535221:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22e01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796650.535976:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796650.536075:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936230656 00000100:00100000:1.0:1788796650.536085:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936230656 00000100:00100000:1.0:1788796650.536142:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 106 00000100:00100000:1.0:1788796650.536152:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+51:10528:x1875688936230656:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796650.536176:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796650.536196:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea51 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.536291:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22e0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.536305:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22e0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.536315:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22e0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796650.536346:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788796650.536351:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796650.536385:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22e0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.536417:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea51 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.536435:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22e0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea51 expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.536442:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:1.0:1788796650.536445:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796650.536448:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334400, rc 0) 00000100:00100000:1.0:1788796650.536515:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+52:10528:x1875688936230656:12345-192.168.201.25@tcp:101:bash.0 Request processed in 364us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796650.536522:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 106 00000100:00100000:0.0:1788796650.550617:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796650.550733:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936230912 00000100:00100000:1.0:1788796650.550821:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936230912 00000100:00100000:1.0:1788796650.551011:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:1.0:1788796650.551022:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+52:10528:x1875688936230912:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:1.0:1788796650.551302:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+53:10528:x1875688936230912:12345-192.168.201.25@tcp:35:bash.0 Request processed in 281us (693us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788796650.551309:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:2.0:1788796650.673393:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796650.673473:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936231040 00000100:00100000:1.0:1788796650.673483:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936231040 00000100:00100000:1.0:1788796650.673554:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 107 00000100:00100000:1.0:1788796650.673564:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+53:10534:x1875688936231040:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796650.673589:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796650.673625:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea58 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.673689:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22e1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.673703:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.673714:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796650.673793:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788796650.673797:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796650.673814:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.673838:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea58 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.673857:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22e1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea58 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.673866:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796650.673869:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788796650.673872:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334600, rc 0) 00000100:00100000:1.0:1788796650.673935:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+54:10534:x1875688936231040:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 372us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796650.673942:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 107 00000100:00100000:1.0:1788796650.678489:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796650.678602:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936231168 00000100:00100000:2.0:1788796650.678615:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936231168 00000100:00100000:2.0:1788796650.679042:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 108 00000100:00100000:2.0:1788796650.682135:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+54:10534:x1875688936231168:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788796650.682161:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796650.682185:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe22e24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea5f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682297:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682312:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682325:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682340:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe22e32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682348:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe22e32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682354:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe22e32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682450:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22e39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682466:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682472:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796650.682510:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788796650.682515:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788796650.682534:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682545:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682553:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682559:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682567:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682572:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796650.682577:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682584:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682595:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:2.0:1788796650.682598:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796650.682610:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682616:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682631:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe22e32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682637:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe22e32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682643:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe22e32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682649:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796650.682652:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe22e32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682658:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe22e32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682667:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd24d573d00) 00010000:00010000:2.0:1788796650.682669:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796650.682672:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe22e32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682678:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe22e32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682709:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe22e24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea5f expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.682736:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22e39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea5f expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.683715:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:2.0:1788796650.683722:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788796650.683727:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6e00, rc 0) 00000100:00100000:2.0:1788796650.684176:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+55:10534:x1875688936231168:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 2063us (5692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796650.684185:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 108 00000100:00100000:3.0:1788796650.694136:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796650.694187:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796650.697035:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936231424 00000100:00100000:1.0:1788796650.697066:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936231424 00000100:00100000:1.0:1788796650.697146:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 109 00000100:00100000:1.0:1788796650.697157:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+55:10534:x1875688936231424:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796650.697177:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796650.697210:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.697310:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.697324:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22e0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea51 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.697333:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22e39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea5f expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.697341:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.697373:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22e39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea5f expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.697387:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22e39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea5f expref: 56 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796650.697401:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d67800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959316736:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796650.697512:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22e0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea51 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.697540:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22e0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea51 expref: 56 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796650.697549:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d64380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959316864:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788796650.697575:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd252760f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788796650.699490:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936231552 00000100:00100000:0.0:1788796650.699505:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936231552 00010000:00010000:0.0:1788796650.699548:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22e39 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea5f expref: 57 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796650.699594:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:0.0:1788796650.699603:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267830000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+57:2355:x1875688936231552:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796650.699630:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796650.699636:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22e39 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea5f expref: 57 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.699650:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22e39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea5f expref: 57 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.699671:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:0.0:1788796650.699676:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.699684:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.699691:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796650.699782:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267830000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+57:2355:x1875688936231552:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 145us (5559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796650.699789:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00010000:00010000:2.0:1788796650.704862:0:5846:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.25@tcp) returned -22 from blocking AST (req@00000000161d09a7 x1875688959316736) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22e39 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea5f expref: 56 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.704901:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22e39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea5f expref: 56 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796650.704923:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d67800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959316736:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796650.704939:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d64380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959316864:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796650.704965:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:2.0:1788796650.704970:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.704981:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.704990:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796650.706442:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796650.706671:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936231680 00000100:00100000:2.0:1788796650.706681:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936231680 00010000:00010000:2.0:1788796650.706723:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22e0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea51 expref: 56 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796650.706785:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:2.0:1788796650.706797:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+56:2358:x1875688936231680:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796650.706814:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796650.706820:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22e0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea51 expref: 56 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.706833:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22e0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea51 expref: 56 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.706857:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22e0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea51 expref: 56 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.706885:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:2.0:1788796650.706896:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.706906:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.706913:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.706944:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796650.707101:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.707110:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796650.707132:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00100000:2.0:1788796650.707665:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+55:2358:x1875688936231680:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 867us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796650.707674:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 53 00010000:00010000:1.0:1788796650.707832:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea66 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.707852:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea66 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.707860:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:1.0:1788796650.707863:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788796650.707866:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335c00, rc 0) 00000100:00100000:1.0:1788796650.708008:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+55:10534:x1875688936231424:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 10853us (13883us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788796650.708016:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 109 00000100:00100000:3.0:1788796650.716854:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796650.725400:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936231936 00000100:00100000:0.0:1788796650.725418:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936231936 00000100:00100000:0.0:1788796650.725560:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:0.0:1788796650.725572:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267831c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+55:10534:x1875688936231936:12345-192.168.201.25@tcp:103:lfs.0 00010000:00010000:0.0:1788796650.725591:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796650.725619:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22da6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea3c expref: 55 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796650.725642:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:0.0:1788796650.725660:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796650.725731:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267831c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+54:10534:x1875688936231936:12345-192.168.201.25@tcp:103:lfs.0 Request processed in 161us (8997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796650.725739:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1788796650.732687:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796650.733177:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936232064 00000100:00100000:3.0:1788796650.733197:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936232064 00000100:00100000:3.0:1788796650.733287:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 110 00000100:00100000:3.0:1788796650.733297:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+54:10534:x1875688936232064:12345-192.168.201.25@tcp:58:lfs.0 00010000:00010000:3.0:1788796650.733413:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22e55 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796650.733430:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22e55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796650.733442:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22e55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788796650.733631:0:10139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788796650.733722:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+54:10534:x1875688936232064:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 426us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796650.733730:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 110 00000100:00100000:1.0:1788796650.739443:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796650.739579:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936232192 00000100:00100000:3.0:1788796650.739590:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936232192 00000100:00100000:3.0:1788796650.739690:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 111 00000100:00100000:3.0:1788796650.739702:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+54:10534:x1875688936232192:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788796650.739723:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796650.739781:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22e5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea6d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796650.739844:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22e55 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796650.739857:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22e5c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea6d expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796650.740087:0:5845:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22e55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796650.740103:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22e5c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea6d expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796650.740117:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:3.0:1788796650.740120:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788796650.740124:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22e5c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea6d expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796650.740131:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21000, rc 0) 00000100:00100000:3.0:1788796650.740248:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+55:10534:x1875688936232192:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 548us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796650.740256:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 111 00010000:00010000:2.0:1788796650.846738:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788796650.970029:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788796650.970040:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788796650.970114:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788796650.970122:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788796650.970242:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267305500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1875688959316992:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788796650.970348:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a4ae540 going to sleep for 11 seconds 00000100:00100000:1.0:1788796650.975824:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796650.976187:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936232320 00000100:00100000:2.0:1788796650.976197:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936232320 00000100:00100000:2.0:1788796650.976261:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 112 00000100:00100000:2.0:1788796650.976269:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+56:10535:x1875688936232320:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788796650.976299:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788796650.976405:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+56:10535:x1875688936232320:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 137us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796650.976411:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 112 00000100:00100000:0.0:1788796650.976862:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267305500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1875688959316992:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788796650.985208:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796650.986352:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936232448 00000100:00100000:1.0:1788796650.986966:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936232448 00000100:00100000:1.0:1788796650.987108:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 113 00000100:00100000:1.0:1788796650.987120:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+55:10535:x1875688936232448:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788796650.987213:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22e63 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987232:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22e63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987254:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22e63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987319:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22e6a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987327:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22e6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987333:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22e6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987361:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987389:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987398:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796650.987462:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788796650.987467:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796650.987478:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987489:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22e63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987496:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22e63 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987502:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22e63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987507:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796650.987511:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22e63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987518:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22e63 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987530:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:1.0:1788796650.987533:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796650.987538:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22e63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987544:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22e63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987557:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22e6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987571:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22e6a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987578:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22e6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987583:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796650.987586:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22e6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987592:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22e6a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987600:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9bd255d57400) 00010000:00010000:1.0:1788796650.987603:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796650.987605:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22e6a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987611:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22e6a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987627:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987632:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987637:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987641:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796650.987649:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987655:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987663:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:1.0:1788796650.987665:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796650.987668:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796650.987673:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22e71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796650.988085:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+55:10535:x1875688936232448:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 Request processed in 964us (2883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796650.988094:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 113 00000100:00100000:1.0:1788796650.991473:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796650.991601:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936232704 00000100:00100000:2.0:1788796650.991611:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936232704 00000100:00100000:2.0:1788796650.991672:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:2.0:1788796650.991681:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+55:10535:x1875688936232704:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788796650.991701:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796650.991721:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe22e78 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea74 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.992092:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.992108:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.992121:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796650.992149:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788796650.992267:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.992275:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.992281:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.992287:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796650.992291:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.992299:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.992313:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:2.0:1788796650.992316:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788796650.992321:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.992328:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22e7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.992374:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe22e78 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea74 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.992385:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:2.0:1788796650.992387:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788796650.992397:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe22e78 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea74 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796650.992408:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6800, rc 0) 00000100:00100000:2.0:1788796650.992473:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+56:10535:x1875688936232704:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 792us (1011us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788796650.992481:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:2.0:1788796650.996217:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796650.996514:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936232832 00000100:00100000:3.0:1788796650.996526:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936232832 00000100:00100000:3.0:1788796650.996587:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:3.0:1788796650.996597:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+56:10535:x1875688936232832:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788796650.996635:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788796650.996774:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+56:10535:x1875688936232832:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 150us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796650.996896:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:3.0:1788796651.001565:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796651.002357:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936233088 00000100:00100000:0.0:1788796651.002380:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936233088 00000100:00100000:0.0:1788796651.002446:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:0.0:1788796651.002457:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+56:10535:x1875688936233088:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788796651.002478:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796651.002480:0:10139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788796651.002508:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22e1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea58 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.002528:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:0.0:1788796651.002534:0:10139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788796651.002548:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22e8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea7b expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788796651.003597:0:10139:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788796651.003942:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22e94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.003972:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.003983:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.004064:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe22e8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea7b expref: 58 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.004086:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22e94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea7b expref: 57 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.004094:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd24d5f1300) 00010000:00010000:0.0:1788796651.004097:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788796651.004100:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5200, rc 0) 00000100:00100000:0.0:1788796651.004524:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+57:10535:x1875688936233088:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1709us (2609us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788796651.004536:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:2.0:1788796651.011210:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796651.011539:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936233344 00000100:00100000:1.0:1788796651.011550:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936233344 00000100:00100000:1.0:1788796651.011607:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00100000:1.0:1788796651.011617:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+57:10535:x1875688936233344:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788796651.011672:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796651.011701:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22e94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea7b expref: 57 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.011720:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd24d5f1300) 00010000:00010000:1.0:1788796651.011731:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796651.011793:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22ea2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.011822:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22ea2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.011831:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22ea2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.011905:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ea9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x71b45e42 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.011913:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x71b45e42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.011919:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x71b45e42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.011983:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22ea2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.011990:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22ea2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.011996:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22ea2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.012002:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796651.012006:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22ea2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.012013:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22ea2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.012021:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:1.0:1788796651.012029:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796651.012034:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22ea2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.012051:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22ea2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.012064:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x71b45e42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.012070:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ea9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x71b45e42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.012075:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x71b45e42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.012080:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796651.012083:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x71b45e42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.012089:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ea9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x71b45e42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.012097:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x71b45e42 (ffff9bd255d57400) 00010000:00010000:1.0:1788796651.012099:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796651.012102:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ea9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x71b45e42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.012107:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ea9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x71b45e42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796651.012200:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+56:10535:x1875688936233344:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 583us (997us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788796651.012215:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00100000:2.0:1788796651.014783:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796651.016150:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936233472 00000100:00100000:1.0:1788796651.016173:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936233472 00000100:00100000:1.0:1788796651.016252:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 118 00000100:00100000:1.0:1788796651.016263:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+56:10535:x1875688936233472:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788796651.016285:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796651.016308:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22eb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea82 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.016342:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22eb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.016356:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.016368:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.016466:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22eb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea82 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.016483:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea82 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.016492:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796651.016494:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788796651.016498:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335e00, rc 0) 00000100:00100000:1.0:1788796651.016581:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+57:10535:x1875688936233472:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 320us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796651.016594:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 118 00000100:00100000:0.0:1788796651.019820:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796651.020226:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936233728 00000100:00100000:1.0:1788796651.020245:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936233728 00000100:00100000:1.0:1788796651.020315:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 119 00000100:00100000:1.0:1788796651.020327:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+57:10535:x1875688936233728:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788796651.020424:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ebe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.020443:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.020459:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788796651.020725:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1788796651.020736:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378001989104ns, next at 379001986319ns, rc = 0 00000004:00010000:1.0:1788796651.020856:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa6268d3 reply state 00000000af4ab701 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796651.020865:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788796651.021586:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+59:10535:x1875688936233728:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 1257us (1770us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788796651.021595:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 119 00010000:00010000:3.0:1788796651.031359:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.031378:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ebe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.031386:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ebe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.031392:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796651.031397:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ebe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.031405:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ebe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.031423:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:3.0:1788796651.031426:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788796651.031430:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ebe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.031436:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22ebe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796651.033475:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796651.033610:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936233856 00000100:00100000:1.0:1788796651.033621:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936233856 00000100:00100000:1.0:1788796651.033684:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:1.0:1788796651.033695:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+58:10535:x1875688936233856:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788796651.033720:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796651.033793:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22ec5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea89 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.033858:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea89 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.033873:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea89 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.033894:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796651.033897:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788796651.033901:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334e00, rc 0) 00000100:00100000:1.0:1788796651.033952:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+59:10535:x1875688936233856:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 259us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796651.033960:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:2.0:1788796651.057431:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796651.057529:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936233984 00000100:00100000:0.0:1788796651.057540:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936233984 00000100:00100000:0.0:1788796651.057609:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:0.0:1788796651.057619:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+8:2357:x1875688936233984:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788796651.057982:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+9:2357:x1875688936233984:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 364us (560us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788796651.058008:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00080000:3.0:1788796651.059327:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788796651.061424:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796651.062014:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936234240 00000100:00100000:0.0:1788796651.062025:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936234240 00000100:00100000:0.0:1788796651.062099:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:0.0:1788796651.062109:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+59:10535:x1875688936234240:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788796651.062603:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+60:10535:x1875688936234240:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 493us (1187us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788796651.062611:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:1.0:1788796651.071348:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796651.071464:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936234496 00000100:00100000:3.0:1788796651.071476:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936234496 00000100:00100000:3.0:1788796651.071544:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:3.0:1788796651.071554:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+60:10535:x1875688936234496:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788796651.071672:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+60:10535:x1875688936234496:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 119us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796651.071695:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:2.0:1788796651.077914:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796651.078140:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936234624 00000100:00100000:1.0:1788796651.078151:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936234624 00000100:00100000:1.0:1788796651.078322:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 122 00000100:00100000:1.0:1788796651.078333:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+60:10535:x1875688936234624:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788796651.078355:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796651.078376:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ecc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea90 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.078445:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22ed3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.078591:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.078618:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796651.078656:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796651.078675:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.078702:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ecc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea90 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.078719:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea90 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.078729:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796651.078732:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788796651.078736:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335a00, rc 0) 00000100:00100000:1.0:1788796651.078846:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+61:10535:x1875688936234624:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 514us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796651.078853:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 122 00000100:00100000:2.0:1788796651.082412:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796651.082569:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936234752 00000100:00100000:0.0:1788796651.082581:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936234752 00000100:00100000:0.0:1788796651.082640:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:0.0:1788796651.082650:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+9:2355:x1875688936234752:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788796651.082668:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796651.082692:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005349edb/0xdd273c88cfe22eda lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea97 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788796651.082723:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9edeeb, blocks: 0x1 00010000:00010000:0.0:1788796651.082789:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1788796651.082795:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796651.082804:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005349edb/0xdd273c88cfe22eda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea97 expref: 10 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.082824:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000005349edb/0xdd273c88cfe22eda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea97 expref: 10 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.082860:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d4800, rc 0) 00000100:00100000:0.0:1788796651.082912:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+10:2355:x1875688936234752:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 263us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796651.082920:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:2.0:1788796651.090993:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796651.092075:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936235008 00000100:00100000:3.0:1788796651.092088:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936235008 00000100:00100000:3.0:1788796651.092262:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 123 00000100:00100000:3.0:1788796651.092275:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+61:10535:x1875688936235008:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788796651.092397:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+61:10535:x1875688936235008:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 125us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796651.092405:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 123 00000100:00100000:2.0:1788796651.109552:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796651.109705:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936235136 00000100:00100000:0.0:1788796651.109714:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936235136 00000100:00100000:0.0:1788796651.109790:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:0.0:1788796651.109801:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+10:10535:x1875688936235136:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788796651.109821:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796651.109841:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe22ee1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ea9e expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.109874:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005349edb/0xdd273c88cfe22eda lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea97 expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.109884:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796651.109889:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796651.109895:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe22ee1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea9e expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.109929:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005349edb/0xdd273c88cfe22eda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea97 expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.109943:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005349edb/0xdd273c88cfe22eda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea97 expref: 11 pid: 6694 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796651.109973:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267307b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1875688959317120:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788796651.110808:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb78840 going to sleep for 11 seconds 00000100:00100000:0.0:1788796651.113064:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267307b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1875688959317120:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796651.113114:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe22ee1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea9e expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.113135:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5200, rc 0) 00000100:00100000:2.0:1788796651.113536:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796651.113782:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936235264 00000100:00100000:1.0:1788796651.113790:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936235264 00010000:00010000:1.0:1788796651.113828:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005349edb/0xdd273c88cfe22eda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea97 expref: 12 pid: 6694 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796651.113866:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:1.0:1788796651.113876:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd245993050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+12:2357:x1875688936235264:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788796651.113900:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796651.113938:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005349edb/0xdd273c88cfe22eda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea97 expref: 12 pid: 6694 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.113950:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005349edb/0xdd273c88cfe22eda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea97 expref: 12 pid: 6694 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.113975:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005349edb/0xdd273c88cfe22eda lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea97 expref: 12 pid: 6694 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.113992:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796651.113997:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796651.114018:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe22ee1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea9e expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.114029:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe22ee1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea9e expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.114074:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe22ee1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea9e expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796651.114090:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d66300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1875688959317248:192.168.201.25@tcp:105: 00000100:00100000:1.0:1788796651.114181:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd252760300 going to sleep for 11 seconds 00000100:00100000:0.0:1788796651.115898:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+11:10535:x1875688936235136:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 6082us (6340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796651.115910:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:0.0:1788796651.124614:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d66300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1875688959317248:192.168.201.25@tcp:105: 00010000:00010000:0.0:1788796651.124646:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796651.124697:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd245993050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+10:2357:x1875688936235264:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 10821us (11161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796651.124707:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:0.0:1788796651.132993:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796651.133217:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936235392 00000100:00100000:2.0:1788796651.133228:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936235392 00002000:00100000:2.0:1788796651.133289:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9bd267307b80 x1875688936235392/t0(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:77/0 lens 504/0 e 0 to 0 dl 1788796662 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788796651.133299:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd267307b80 with x1875688936235392 ext(0->12) 00002000:00010000:2.0:1788796651.133305:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd267307b80 00000100:00100000:2.0:1788796651.133343:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:2.0:1788796651.133353:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad2796a3-2145-47da-88fb-baa43721bec1+10:2358:x1875688936235392:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788796651.133776:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad2796a3-2145-47da-88fb-baa43721bec1+12:2358:x1875688936235392:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 Request processed in 423us (790us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788796651.133790:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00002000:00100000:2.0:1788796651.133799:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9bd267307b80 x1875688936235392/t4294967308(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:77/0 lens 504/448 e 0 to 0 dl 1788796662 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788796651.133807:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd267307b80 with x1875688936235392 ext(0->12) 00002000:00010000:2.0:1788796651.133810:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd267307b80 00000100:00100000:2.0:1788796651.139222:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796651.139496:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936235520 00000100:00100000:0.0:1788796651.139506:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936235520 00000100:00100000:0.0:1788796651.139571:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 124 00000100:00100000:0.0:1788796651.139582:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+61:10535:x1875688936235520:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788796651.291781:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1788796651.291810:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788796651.291827:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd24db48480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788796651.291832:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd245ec8200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd24133e600 00000020:00080000:2.0:1788796651.291835:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd245ec8800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd2613db800 00000004:00080000:2.0:1788796651.291857:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788796651.291898:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1788796651.291917:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788796651.291929:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd250a83900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788796651.291932:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd27e66bf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd250a830c0 00000020:00080000:2.0:1788796651.291934:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd27e66b900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd250a53800 00000020:00080000:2.0:1788796651.291963:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788796651.292151:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788796651.292411:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959317376:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788796651.292476:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796651.292545:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26130b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959317504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788796651.292571:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796651.292621:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959317376 00000100:00100000:2.0:1788796651.292629:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959317376 00000100:00100000:2.0:1788796651.292677:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959317504 00000100:00100000:2.0:1788796651.292681:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959317504 00000100:00100000:2.0:1788796651.292700:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788796651.292709:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1875688959317376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788796651.292733:0:6694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1788796651.292779:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed942e3/0xdd273c88cfe22ee8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.292801:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22caa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9fd expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.292810:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788796651.292814:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788796651.292818:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed942e3/0xdd273c88cfe22ee8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.292844:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22caa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9fd expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.292857:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22caa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9fd expref: 11 pid: 6694 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796651.292869:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d26680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1875688959317632:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796651.292926:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd242e476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796651.292942:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788796651.292955:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1875688959317504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788796651.293111:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788796651.293116:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788796651 00002000:00010000:2.0:1788796651.293118:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788796651.293121:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788796651 -> 1788796651 00002000:00010000:2.0:1788796651.293123:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788796651.295387:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3304:x1875688959317504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2423us (2805us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788796651.295420:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788796651.295468:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788796651.295628:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd26130b100/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788796651.295635:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26130b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959317504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788796651.295648:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796651.295657:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959317760:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788796651.295704:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796651.295758:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959317760 00000100:00100000:2.0:1788796651.295765:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959317760 00000100:00100000:2.0:1788796651.295798:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788796651.295805:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3304:x1875688959317760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788796651.295832:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1788796651.295867:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9edeea, atime: 0x6a9edeea, ctime: 0x6a9edeea, blocks: 0x1 00010000:00010000:2.0:1788796651.295877:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013cb47c0/0xdd273c88cfe22eef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.295893:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1788796651.295898:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796651.295904:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013cb47c0/0xdd273c88cfe22eef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.295932:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013cb47c0/0xdd273c88cfe22eef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.295942:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013cb47c0/0xdd273c88cfe22eef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.295949:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013cb47c0/0xdd273c88cfe22eef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.295967:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788796651.299788:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+15:10535:x1875688936235520:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 Request processed in 160199us (160566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796651.299802:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 124 00000100:00100000:2.0:1788796651.301523:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3304:x1875688959317760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5708us (5808us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788796651.301536:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1788796651.301581:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796651.301590:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013cb47c0/0xdd273c88cfe22eef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.301602:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6a00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796651.301607:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013cb47c0/0xdd273c88cfe22eef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.301618:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013cb47c0/0xdd273c88cfe22eef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.301639:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013cb47c0/0xdd273c88cfe22eef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.301664:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013cb47c0/0xdd273c88cfe22eef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.301688:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796651.301690:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796651.301691:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788796651.306288:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd247d64000/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788796651.306302:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959317760:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788796651.309058:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d26680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1875688959317632:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796651.309089:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eed942e3/0xdd273c88cfe22ee8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796651.316843:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796651.316904:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796651.317023:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936235776 00000100:00100000:0.0:1788796651.317044:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936235776 00000100:00100000:0.0:1788796651.317103:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:0.0:1788796651.317113:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+12:2357:x1875688936235776:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788796651.317343:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936235648 00000100:00100000:3.0:1788796651.317348:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936235648 00010000:00010000:3.0:1788796651.317385:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22caa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9fd expref: 13 pid: 6694 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796651.317418:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:3.0:1788796651.317425:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+13:2358:x1875688936235648:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796651.317435:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796651.317440:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22caa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9fd expref: 13 pid: 6694 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.317453:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22caa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9fd expref: 13 pid: 6694 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.317493:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe22caa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9fd expref: 13 pid: 6694 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.317513:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788796651.317517:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788796651.317524:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eed942e3/0xdd273c88cfe22ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.317533:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed942e3/0xdd273c88cfe22ee8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.317565:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796651.317614:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+12:2358:x1875688936235648:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 189us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796651.317621:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 55 00010000:00010000:3.0:1788796651.317646:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eed942e3/0xdd273c88cfe22ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.317655:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eed942e3/0xdd273c88cfe22ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.317665:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed942e3/0xdd273c88cfe22ee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.317672:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eed942e3/0xdd273c88cfe22ee8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.317692:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788796651.318313:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3307:x1875688959317376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25603us (25835us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788796651.318322:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788796651.319654:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796651.319666:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eed942e3/0xdd273c88cfe22ee8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.319677:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6000 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796651.319681:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed942e3/0xdd273c88cfe22ee8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.319691:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed942e3/0xdd273c88cfe22ee8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.319708:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eed942e3/0xdd273c88cfe22ee8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.319715:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eed942e3/0xdd273c88cfe22ee8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.319737:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796651.319775:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796651.319777:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788796651.319818:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd27d7adc00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788796651.319826:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959317376:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788796651.366563:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959317888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796651.366646:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796651.366719:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959317888 00000100:00100000:2.0:1788796651.366728:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959317888 00000100:00100000:2.0:1788796651.366791:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788796651.366801:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3306:x1875688959317888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788796651.366826:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796651.369626:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3306:x1875688959317888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796651.369650:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788796651.369775:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959317888:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788796651.406189:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1788796651.406207:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788796651.406212:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1788796651.406236:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:3.0:1788796651.406342:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:2357:x1875688936235776:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 Request processed in 89225us (89431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796651.406353:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:3.0:1788796651.408692:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796651.408962:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936236032 00000100:00100000:1.0:1788796651.408988:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936236032 00000100:00100000:1.0:1788796651.409066:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00100000:1.0:1788796651.409077:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+15:10535:x1875688936236032:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788796651.409136:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796651.409176:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22ed3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea90 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.409197:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796651.409203:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796651.409245:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ef6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.409260:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.409270:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788796651.409532:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff28b0a1 reply state 000000001f82ba02 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796651.409543:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788796651.409640:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+16:10535:x1875688936236032:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 565us (955us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788796651.409648:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00100000:3.0:1788796651.412244:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796651.412286:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936236160 00000100:00100000:3.0:1788796651.412297:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936236160 00000100:00100000:3.0:1788796651.412348:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:3.0:1788796651.412358:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+6:2357:x1875688936236160:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788796651.412844:0:11435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788796651.412849:0:11435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788796651 -> 1788796651 00002000:00010000:3.0:1788796651.412851:0:11435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788796650 00002000:00010000:3.0:1788796651.412853:0:11435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788796651 -> 1788796651 00002000:00010000:3.0:1788796651.412855:0:11435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788796651.412911:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936236160:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 555us (683us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788796651.412918:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00010000:00010000:2.0:1788796651.416422:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.416442:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ef6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.416451:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ef6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.416457:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796651.416462:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ef6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.416470:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ef6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.416502:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:2.0:1788796651.416505:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796651.416511:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ef6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.416517:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22ef6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796651.437149:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796651.437266:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936236416 00000100:00100000:3.0:1788796651.437276:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936236416 00000100:00100000:3.0:1788796651.437342:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 126 00000100:00100000:3.0:1788796651.437354:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+15:10535:x1875688936236416:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788796651.437426:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22efd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.437443:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22eb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea82 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.437452:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22efd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.437484:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea82 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.437498:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22eb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea82 expref: 15 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796651.437512:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875688959318016:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788796651.437601:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249ef2300 going to sleep for 11 seconds 00000100:00100000:3.0:1788796651.451983:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796651.452084:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875688959318016:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796651.452113:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22efd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796651.453988:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936236544 00000100:00100000:2.0:1788796651.454004:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936236544 00010000:00010000:2.0:1788796651.454065:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22eb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea82 expref: 16 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796651.454106:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:2.0:1788796651.454117:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+16:2358:x1875688936236544:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796651.454134:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796651.454141:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22eb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea82 expref: 16 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.454154:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea82 expref: 16 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.454444:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22eb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea82 expref: 16 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.454463:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:2.0:1788796651.454469:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22efd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.454493:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.454502:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22efd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.454535:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796651.454663:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.454678:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.454708:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.454714:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22efd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.454721:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22efd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.454727:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796651.454732:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22efd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.454738:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22efd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.454766:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796651.454769:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788796651.454773:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22efd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.454780:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22efd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796651.456361:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+15:2358:x1875688936236544:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 2236us (4378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796651.456375:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:1.0:1788796651.460620:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+14:10535:x1875688936236416:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 Request processed in 23257us (23469us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788796651.460634:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 126 00000100:00100000:2.0:1788796651.472024:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796651.472110:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936236672 00000100:00100000:3.0:1788796651.472121:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936236672 00000100:00100000:3.0:1788796651.472182:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:3.0:1788796651.472192:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:2356:x1875688936236672:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788796651.472244:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe22f04 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.472281:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe22ee1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea9e expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.472290:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796651.472295:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788796651.472299:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe22f04 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.472336:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe22ee1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea9e expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.472351:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe22ee1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea9e expref: 7 pid: 6691 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796651.472366:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e847800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875688959318144:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788796651.472449:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249ef2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788796651.476191:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796651.476287:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936236800 00000100:00100000:2.0:1788796651.476298:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936236800 00010000:00010000:2.0:1788796651.476341:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe22ee1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea9e expref: 8 pid: 6691 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796651.476383:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:2.0:1788796651.476392:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267307800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+8:2358:x1875688936236800:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796651.476408:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796651.476432:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe22ee1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea9e expref: 8 pid: 6691 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.476446:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe22ee1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea9e expref: 8 pid: 6691 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.476471:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788796651.476476:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788796651.476495:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe22f04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.476506:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe22f04 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.476526:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796651.476578:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267307800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+8:2358:x1875688936236800:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 186us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796651.476584:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 57 00010000:00010000:3.0:1788796651.477333:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe22ee1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea9e expref: 7 pid: 6691 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796651.477351:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e847800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875688959318144:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788796651.477376:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe22f04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.477386:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe22f04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.477403:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe22f04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.477430:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe22f04 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.477438:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe22f04 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.477446:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe22f04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.477452:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20200 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796651.477456:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe22f04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.477465:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe22f04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.477478:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe22f04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.477485:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe22f04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796651.477603:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936236672:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 Request processed in 5411us (5587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796651.477612:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:1.0:1788796651.487139:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796651.491543:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936237056 00000100:00100000:3.0:1788796651.491560:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936237056 00000100:00100000:3.0:1788796651.491633:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 127 00000100:00100000:3.0:1788796651.491645:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+14:10535:x1875688936237056:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788796651.491730:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe22f0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.491769:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe22f0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.491781:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe22f0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.492004:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22f12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.492016:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22ec5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea89 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.492024:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22f12 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.492072:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea89 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.492108:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22ec5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea89 expref: 15 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796651.492124:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e847800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959318272:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788796651.492413:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249ef2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788796651.494900:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796651.494983:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936237184 00000100:00100000:0.0:1788796651.494992:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936237184 00010000:00010000:0.0:1788796651.495030:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22ec5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea89 expref: 16 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796651.495080:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:0.0:1788796651.495090:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+16:2357:x1875688936237184:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796651.495103:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796651.495111:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22ec5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea89 expref: 16 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.495124:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22ec5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea89 expref: 16 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.495144:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:0.0:1788796651.495149:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22f12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.495169:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22f12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.495190:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22f12 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.495213:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796651.495266:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+16:2357:x1875688936237184:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 177us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796651.495273:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 58 00010000:00010000:3.0:1788796651.495594:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22ec5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea89 expref: 15 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796651.495611:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e847800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959318272:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788796651.495633:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22f12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.495642:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22f12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.495647:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22f12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788796651.495900:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1788796651.496056:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1788796651.496106:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1788796651.496196:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e847800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875688959318400:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788796651.496240:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796651.496262:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2412ed900 going to sleep for 11 seconds 00000100:00100000:0.0:1788796651.497640:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959318400 00000100:00100000:0.0:1788796651.497652:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959318400 00000100:00100000:0.0:1788796651.497712:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788796651.497722:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875688959318400:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788796651.497861:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875688959318400:12345-0@lo:1000:mdt00_002.0 Request processed in 140us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796651.497869:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788796651.500003:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788796651.500016:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1788796651.500046:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd26130b100, transno 4294967309 00000004:00080000:3.0:1788796651.500066:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd27d7adc00, transno 4294967310 00000100:00100000:3.0:1788796651.500076:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e847800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875688959318400:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788796651.500619:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788796651.500702:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e847800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875688959318528:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788796651.500807:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796651.500836:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250ba1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796651.502339:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959318528 00000100:00100000:0.0:1788796651.502351:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959318528 00000100:00100000:0.0:1788796651.503297:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788796651.503313:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875688959318528:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788796651.504362:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1875688959318528:12345-0@lo:1000:mdt00_002.0 Request processed in 1050us (3551us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788796651.504383:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788796651.511631:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e847800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875688959318528:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788796651.513280:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1788796651.513299:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788796651.513310:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:2.0:1788796651.515890:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22f12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.515908:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22f12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.515916:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22f12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.515923:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796651.515928:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22f12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.515935:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22f12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.515951:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:2.0:1788796651.515954:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788796651.515958:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22f12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.515977:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe22f12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.516022:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22e55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.516028:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22e55 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.516042:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22e55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.516046:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796651.516049:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22e55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.516054:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22e55 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.516061:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:2.0:1788796651.516063:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788796651.516072:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22e5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea6d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.516084:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22e5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea6d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.516094:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22e5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea6d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.516367:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22e5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea6d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796651.516384:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d26680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959318656:192.168.201.25@tcp:105: 00000100:00100000:2.0:1788796651.516555:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788796651.521004:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d26680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959318656:192.168.201.25@tcp:105: 00010000:00010000:3.0:1788796651.521048:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22e55 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521061:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe22e55 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521099:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22f19 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521114:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22f19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521127:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22f19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521137:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22f19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521144:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22f19 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521150:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22f19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521180:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796651.521184:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22f19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521193:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22f19 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521205:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:3.0:1788796651.521209:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796651.521213:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22f19 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521218:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe22f19 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521230:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe22f0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521236:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe22f0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521241:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe22f0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521246:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20c00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796651.521249:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe22f0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521255:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe22f0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521273:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:3.0:1788796651.521275:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788796651.521278:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe22f0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.521284:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20c00/0xdd273c88cfe22f0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796651.521544:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+18:10535:x1875688936237056:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 29899us (34414us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1788796651.521555:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 127 00000020:00080000:3.0:1788796651.521562:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788796651.521792:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788796651.521798:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788796651.522267:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788796651.522283:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788796651.537248:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796651.537293:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796651.537368:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936237440 00000100:00100000:2.0:1788796651.537378:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936237440 00000100:00100000:2.0:1788796651.537418:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936237568 00000100:00100000:2.0:1788796651.537421:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936237568 00000100:00100000:1.0:1788796651.537428:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:1.0:1788796651.537440:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+19:10535:x1875688936237440:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788796651.538061:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788796651.538310:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788796651.538358:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22f20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.538373:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.538385:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.538395:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22f20 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.538402:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22f20 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.538408:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22f20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796651.538431:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788796651.538534:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+21:10535:x1875688936237440:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 1095us (1294us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788796651.538541:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 31 00000020:00080000:1.0:1788796651.538546:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788796651.538566:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:1.0:1788796651.538575:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2504d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+20:10534:x1875688936237568:12345-192.168.201.25@tcp:49:lfs.0 00000100:00100000:1.0:1788796651.538644:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2504d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+20:10534:x1875688936237568:12345-192.168.201.25@tcp:49:lfs.0 Request processed in 71us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796651.538650:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00010000:00010000:2.0:1788796651.538742:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796651.538765:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22f20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.538772:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334600 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796651.538776:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22f20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.538784:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22f20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.538796:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bd255d57400) 00010000:00010000:2.0:1788796651.538800:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788796651.538805:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22f20 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.538810:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22f20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.538827:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796651.538835:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796651.538837:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796651.544078:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796651.545073:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936237824 00000100:00100000:0.0:1788796651.545085:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936237824 00000100:00100000:0.0:1788796651.545146:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 128 00000100:00100000:0.0:1788796651.545166:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+20:10534:x1875688936237824:12345-192.168.201.25@tcp:58:lfs.0 00000040:00080000:0.0:1788796651.545836:0:10139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788796651.545957:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+20:10534:x1875688936237824:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 800us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796651.545964:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 128 00000100:00100000:2.0:1788796651.588532:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796651.588632:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936237952 00000100:00100000:0.0:1788796651.588643:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936237952 00000100:00100000:0.0:1788796651.588704:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 129 00000100:00100000:0.0:1788796651.588714:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+20:10537:x1875688936237952:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788796651.588741:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796651.588808:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22f27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eaa5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.588876:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22f2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.588891:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22f2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.588902:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22f2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.588916:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22f35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.588938:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22f35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796651.588946:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22f35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.589669:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22f3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.589684:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea66 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.589692:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22f3c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.589727:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea66 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.589741:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea66 expref: 21 pid: 5846 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796651.589841:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267a37b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875688959318784:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796651.589981:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788796651.595701:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796651.596142:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936238208 00000100:00100000:0.0:1788796651.596216:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936238208 00000100:00100000:0.0:1788796651.596269:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:0.0:1788796651.596279:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+22:6057:x1875688936238208:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788796651.596622:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267a37b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875688959318784:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788796651.596647:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22f3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796651.598010:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+23:6057:x1875688936238208:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 1725us (2312us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788796651.598022:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:1.0:1788796651.604994:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796651.605104:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936238336 00000100:00100000:2.0:1788796651.605115:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936238336 00010000:00010000:2.0:1788796651.605167:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea66 expref: 23 pid: 5846 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796651.605209:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:2.0:1788796651.605219:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+23:2358:x1875688936238336:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796651.605235:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796651.605258:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea66 expref: 23 pid: 5846 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.605272:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea66 expref: 23 pid: 5846 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.605296:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22e47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea66 expref: 23 pid: 5846 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.605314:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:2.0:1788796651.605319:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22f3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.605328:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22f3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.605335:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22f3c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796651.605375:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796651.605439:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+22:2358:x1875688936238336:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 221us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796651.605446:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 59 00010000:00010000:3.0:1788796651.605571:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22f3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605581:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22f3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796651.605628:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788796651.605633:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788796651.605654:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22f3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605667:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22f3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605688:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22f2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605694:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22f2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605701:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22f2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605707:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796651.605712:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22f2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605719:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22f2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605728:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:3.0:1788796651.605731:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796651.605735:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22f2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605740:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe22f2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605810:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22f35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605816:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22f35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605822:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22f35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605834:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796651.605837:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22f35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605843:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22f35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605851:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bd24d5f1400) 00010000:00010000:3.0:1788796651.605853:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796651.605856:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22f35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605862:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5200/0xdd273c88cfe22f35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605898:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22f27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaa5 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605912:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22f3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaa5 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796651.605918:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:3.0:1788796651.605920:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788796651.605922:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6200, rc 0) 00000100:00100000:3.0:1788796651.605947:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+21:10537:x1875688936237952:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 17236us (17426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796651.605954:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 129 00010000:00010000:1.0:1788796651.866055:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788796652.574843:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788796652.574867:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788796652.574909:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788796652.574916:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788796652.576365:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e844e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1875688959318912:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788796652.576470:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250ba1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796652.579503:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e844e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1875688959318912:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788796652.582564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796652.583107:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936238464 00000100:00100000:0.0:1788796652.583119:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936238464 00000100:00100000:0.0:1788796652.583213:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 130 00000100:00100000:0.0:1788796652.583223:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+21:10548:x1875688936238464:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788796652.583257:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:3.0:1788796652.583335:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796652.583373:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+21:10548:x1875688936238464:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 151us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796652.583379:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 130 00000100:00100000:1.0:1788796652.591081:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796652.591190:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936238720 00000100:00100000:2.0:1788796652.591199:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936238720 00000100:00100000:2.0:1788796652.591306:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 131 00000100:00100000:2.0:1788796652.591318:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+21:10548:x1875688936238720:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788796652.591338:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796652.591358:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22f43 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eaac expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796652.591461:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22f4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796652.591477:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22f4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796652.591489:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22f4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796652.591500:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788796652.592711:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe22f43 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaac expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796652.592732:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22f4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaac expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796652.592741:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:2.0:1788796652.592765:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788796652.592769:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6400, rc 0) 00000100:00100000:2.0:1788796652.592828:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+23:10548:x1875688936238720:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1513us (1821us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788796652.592837:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 131 00000100:00100000:0.0:1788796652.609376:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796652.609479:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796652.610209:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936238976 00000100:00100000:1.0:1788796652.610232:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936238976 00000100:00100000:1.0:1788796652.610298:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 132 00000100:00100000:1.0:1788796652.610309:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+23:10548:x1875688936238976:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788796652.610396:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22f58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.610416:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22f58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.610429:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22f58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.610635:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22f58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.610643:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22f58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.610651:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22f58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.610671:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796652.610675:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22f58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.610682:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22f58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.610694:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:1.0:1788796652.610697:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788796652.610703:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22f58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.610710:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22f58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796652.610890:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+24:10548:x1875688936238976:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 581us (1522us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788796652.610898:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 132 00000040:00080000:1.0:1788796652.611123:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788796652.611127:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788796652.611630:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788796652.611638:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788796652.617163:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936239104 00000100:00100000:3.0:1788796652.617239:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936239104 00000100:00100000:0.0:1788796652.617367:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1788796652.617379:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267304e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+24:2355:x1875688936239104:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796652.617404:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796652.617431:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe22f4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaac expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796652.617453:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:0.0:1788796652.617458:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796652.617527:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267304e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+23:2355:x1875688936239104:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 150us (8047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796652.617534:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:3.0:1788796652.617802:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796652.619819:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936239360 00000100:00100000:0.0:1788796652.619831:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936239360 00000100:00100000:0.0:1788796652.619902:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:0.0:1788796652.619912:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+23:10548:x1875688936239360:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788796652.620177:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+24:10548:x1875688936239360:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 265us (2374us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788796652.620185:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 34 00000040:00080000:1.0:1788796652.628499:0:12063:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788796652.628510:0:12063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788796652.628557:0:12063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788796652.628563:0:12063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788796652.890740:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796652.895432:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796652.896557:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936239616 00000100:00100000:0.0:1788796652.896570:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936239616 00000100:00100000:0.0:1788796652.896666:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 133 00000100:00100000:0.0:1788796652.896677:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+24:10561:x1875688936239616:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788796652.896701:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796652.896721:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe22f5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eab3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796652.896843:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22f66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796652.896874:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22f66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796652.896885:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22f66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796652.896896:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788796652.897039:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe22f5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eab3 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796652.897058:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22f66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eab3 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796652.897068:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:0.0:1788796652.897071:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788796652.897075:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5e00, rc 0) 00000100:00100000:0.0:1788796652.897133:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+26:10561:x1875688936239616:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 458us (1710us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788796652.897140:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 133 00000100:00100000:3.0:1788796652.916917:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796652.923284:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936239744 00000100:00100000:1.0:1788796652.923303:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936239744 00000100:00100000:1.0:1788796652.923438:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 134 00000100:00100000:1.0:1788796652.923449:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+26:10561:x1875688936239744:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:1.0:1788796652.923526:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22f74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.923545:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.923557:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.923585:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.923593:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22f74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.923600:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.923607:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796652.923612:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.924271:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22f74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.924284:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:1.0:1788796652.924287:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796652.924292:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22f74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796652.924311:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22f74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796652.924407:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+26:10561:x1875688936239744:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 958us (7498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796652.924416:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 134 00000100:00100000:1.0:1788796653.031801:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796653.031897:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936239872 00000100:00100000:3.0:1788796653.031907:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936239872 00000100:00100000:3.0:1788796653.031985:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:3.0:1788796653.031998:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+6:2358:x1875688936239872:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:3.0:1788796653.032023:0:11435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796653.032045:0:11435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf1de98/0xdd273c88cfe22f7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eaba expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788796653.032072:0:11435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9edeeb, atime: 0x6a9edeea, ctime: 0x6a9edeeb, blocks: 0xb 00010000:00010000:3.0:1788796653.032091:0:11435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=380s v=(0 0) 00010000:00010000:3.0:1788796653.032096:0:11435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796653.032106:0:11435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf1de98/0xdd273c88cfe22f7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaba expref: 7 pid: 11435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796653.032123:0:11435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000adf1de98/0xdd273c88cfe22f7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaba expref: 7 pid: 11435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796653.032157:0:11435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20c00, rc 0) 00000100:00100000:3.0:1788796653.032222:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936239872:12345-192.168.201.25@tcp:101:cat.0 Request processed in 228us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796653.032230:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00080000:2.0:1788796653.032882:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796653.036831:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796653.037812:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936240000 00000100:00100000:0.0:1788796653.037826:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936240000 00002000:00100000:0.0:1788796653.037889:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9bd261294380 x1875688936240000/t0(0) o3->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:79/0 lens 488/0 e 0 to 0 dl 1788796664 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788796653.038020:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd261294380 with x1875688936240000 ext(0->4095) 00002000:00010000:0.0:1788796653.038028:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd261294380 00000100:00100000:0.0:1788796653.038071:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:0.0:1788796653.038082:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936240000:12345-192.168.201.25@tcp:3:cat.0 00000100:00100000:0.0:1788796653.038521:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936240000:12345-192.168.201.25@tcp:3:cat.0 Request processed in 439us (1699us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788796653.038530:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00002000:00100000:0.0:1788796653.038537:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9bd261294380 x1875688936240000/t0(0) o3->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:79/0 lens 488/4536 e 0 to 0 dl 1788796664 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788796653.038546:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd261294380 with x1875688936240000 ext(0->4095) 00002000:00010000:0.0:1788796653.038550:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd261294380 00010000:00010000:1.0:1788796653.914107:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796654.426246:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959319040:0@lo:400:kworker.0 00000100:00100000:2.0:1788796654.426318:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796654.426487:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959319040 00000100:00100000:3.0:1788796654.426495:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959319040 00000100:00100000:3.0:1788796654.426539:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788796654.426548:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959319040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796654.426598:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959319040:12345-0@lo:400:kworker.0 Request processed in 50us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796654.426604:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788796654.426637:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd24121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959319296:0@lo:400:kworker.0 00000100:00100000:3.0:1788796654.426663:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796654.426684:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788796654.426689:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd241219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959319168:0@lo:400:kworker.0 00000100:00100000:3.0:1788796654.426709:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796654.426725:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959319680:0@lo:400:kworker.0 00000100:00100000:3.0:1788796654.426776:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796654.426805:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959319296 00000100:00100000:3.0:1788796654.426809:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959319296 00000100:00100000:3.0:1788796654.427079:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959319168 00000100:00100000:3.0:1788796654.427083:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959319168 00000100:00100000:0.0:1788796654.427270:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959319680 00000100:00100000:0.0:1788796654.427275:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959319680 00000100:00100000:0.0:1788796654.427307:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788796654.427314:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959319680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796654.427360:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959319680:12345-0@lo:400:kworker.0 Request processed in 47us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796654.427366:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788796654.428644:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd241219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959319424:0@lo:400:kworker.0 00000100:00100000:1.0:1788796654.428698:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796654.428733:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788796654.428739:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd24121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959319552:0@lo:400:kworker.0 00000100:00100000:1.0:1788796654.428782:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796654.430366:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959319552 00000100:00100000:2.0:1788796654.430387:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959319552 00000100:00100000:2.0:1788796654.430437:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788796654.430445:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959319296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796654.430517:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959319296:12345-0@lo:400:kworker.0 Request processed in 73us (3853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796654.430524:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788796654.430543:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788796654.430550:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959319168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796654.430579:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959319168:12345-0@lo:400:kworker.0 Request processed in 30us (3870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796654.430585:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788796654.430597:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788796654.430603:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959319552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796654.430642:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959319552:12345-0@lo:400:kworker.0 Request processed in 40us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796654.430648:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788796654.430699:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd24121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959319552:0@lo:400:kworker.0 00000100:00080000:2.0:1788796654.434415:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788796654.434426:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796654.434481:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959319040:0@lo:400:kworker.0 00000100:00100000:2.0:1788796654.435859:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd241219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959319168:0@lo:400:kworker.0 00000100:00100000:2.0:1788796654.435875:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788796654.435881:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:2.0:1788796654.435899:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd2671cc700, transno 4294967301 00000004:00080000:2.0:1788796654.435925:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788796654.435944:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd247d64000, transno 4294967304 00000100:00100000:2.0:1788796654.435950:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959319680:0@lo:400:kworker.0 00000100:00100000:2.0:1788796654.435963:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd24121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959319296:0@lo:400:kworker.0 00000100:00100000:2.0:1788796654.436004:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959319424 00000100:00100000:2.0:1788796654.436011:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959319424 00000100:00100000:2.0:1788796654.436065:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788796654.436074:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875688959319424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796654.436339:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875688959319424:12345-0@lo:400:kworker.0 Request processed in 85us (7459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796654.436346:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788796654.436639:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd241219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959319424:0@lo:400:kworker.0 00000100:00080000:2.0:1788796654.436657:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788796654.938186:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959319808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796654.938260:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796654.938485:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959319808 00000100:00100000:0.0:1788796654.938494:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959319808 00000100:00100000:0.0:1788796654.938547:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788796654.938557:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959319808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788796654.938590:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796654.938640:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959319808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796654.938647:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788796654.939109:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959319808:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788796654.939243:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796654.988789:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796654.988838:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796654.988898:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796654.988931:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796654.988955:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796654.989650:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936240128 00000100:00100000:1.0:1788796654.989662:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936240128 00000100:00100000:1.0:1788796654.989725:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 293 00000100:00100000:1.0:1788796654.989736:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936240128:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796654.989868:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936240128:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 134us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796654.989877:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 293 00000100:00100000:2.0:1788796654.990053:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936240640 00000100:00100000:2.0:1788796654.990059:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936240640 00000100:00100000:2.0:1788796654.990098:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936240256 00000100:00100000:2.0:1788796654.990101:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936240256 00000100:00100000:2.0:1788796654.990122:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 148 00000100:00100000:2.0:1788796654.990129:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2358:x1875688936240640:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796654.990161:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2358:x1875688936240640:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 33us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796654.990167:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 148 00000100:00100000:2.0:1788796654.990180:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 149 00000100:00100000:2.0:1788796654.990186:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+26:2358:x1875688936240256:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796654.990222:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+26:2358:x1875688936240256:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 36us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796654.990229:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 149 00000100:00100000:2.0:1788796654.990251:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936240384 00000100:00100000:2.0:1788796654.990254:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936240384 00000100:00100000:2.0:1788796654.990274:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936240512 00000100:00100000:2.0:1788796654.990276:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936240512 00000100:00100000:2.0:1788796654.990296:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:2.0:1788796654.990301:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936240384:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796654.990325:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936240384:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 24us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796654.990331:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:2.0:1788796654.990342:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00100000:2.0:1788796654.990348:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+5:2358:x1875688936240512:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796654.990368:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+5:2358:x1875688936240512:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 20us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796654.990373:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00080000:2.0:1788796654.990387:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788796654.990393:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788796655.968537:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796656.477933:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959319936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796656.478017:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796656.478089:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959319936 00000100:00100000:0.0:1788796656.478105:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959319936 00000100:00100000:0.0:1788796656.478157:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788796656.478165:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875688959319936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796656.478197:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796656.478240:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875688959319936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796656.478247:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788796656.478268:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796656.478302:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267304380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959319936:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788796656.522008:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788796656.522027:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1788796656.533469:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788796656.533526:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788796656.533550:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd2412ed900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788796656.533556:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd27df2d800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd2412ed780 00000020:00080000:2.0:1788796656.533560:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd27df2d500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd267645800 00000020:00080000:0.0:1788796656.533730:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788796656.534084:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1788796656.990099:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796658.010406:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796658.062332:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796658.062410:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936240768 00000100:00100000:0.0:1788796658.062430:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936240768 00000100:00080000:2.0:1788796658.062495:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796658.062509:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 135 00000100:00100000:0.0:1788796658.062520:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+13:10222:x1875688936240768:12345-192.168.201.25@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788796658.062616:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+13:10222:x1875688936240768:12345-192.168.201.25@tcp:60:lhsmtool_posix.0 Request processed in 98us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796658.062624:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 135 00000100:00100000:2.0:1788796658.098183:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796658.098322:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936241024 00000100:00100000:3.0:1788796658.098332:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936241024 00000100:00100000:3.0:1788796658.098397:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:3.0:1788796658.098409:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+13:10222:x1875688936241024:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788796658.101170:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+14:10222:x1875688936241024:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 2753us (2986us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788796658.101183:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00000040:00080000:0.0:1788796658.780337:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788796658.780347:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788796658.780388:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788796658.780396:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788796659.034201:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796659.546174:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959320192:0@lo:400:kworker.0 00000100:00100000:3.0:1788796659.546253:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796659.546347:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959320320:0@lo:400:kworker.0 00000100:00100000:3.0:1788796659.546371:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796659.546403:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959320192 00000100:00100000:3.0:1788796659.546411:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959320192 00000100:00100000:3.0:1788796659.546452:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959320320 00000100:00100000:3.0:1788796659.546455:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959320320 00000100:00100000:3.0:1788796659.546484:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788796659.546492:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959320192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796659.546542:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959320192:12345-0@lo:400:kworker.0 Request processed in 50us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796659.546550:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788796659.546568:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788796659.546573:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959320320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796659.546600:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959320320:12345-0@lo:400:kworker.0 Request processed in 27us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796659.546612:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788796659.546649:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959320320:0@lo:400:kworker.0 00000100:00100000:3.0:1788796659.546670:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959320192:0@lo:400:kworker.0 00000100:00100000:3.0:1788796659.546704:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959320704:0@lo:400:kworker.0 00000100:00100000:3.0:1788796659.546727:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796659.546932:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2612f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959320064:0@lo:400:kworker.0 00000100:00100000:0.0:1788796659.546967:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796659.546998:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959320576:0@lo:400:kworker.0 00000100:00100000:0.0:1788796659.547019:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796659.547046:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788796659.547052:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959320448:0@lo:400:kworker.0 00000100:00100000:0.0:1788796659.547074:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796659.547098:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959320576 00000100:00100000:0.0:1788796659.547104:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959320576 00000100:00100000:0.0:1788796659.547136:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788796659.547143:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959320576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796659.547179:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959320576:12345-0@lo:400:kworker.0 Request processed in 37us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796659.547185:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788796659.547212:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959320576:0@lo:400:kworker.0 00000100:00100000:3.0:1788796659.547278:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959320064 00000100:00100000:3.0:1788796659.547283:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959320064 00000100:00100000:3.0:1788796659.547317:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788796659.547324:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959320064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796659.547357:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959320064:12345-0@lo:400:kworker.0 Request processed in 34us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796659.547364:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:2.0:1788796659.547450:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796659.547463:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959320704 00000100:00100000:2.0:1788796659.547467:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959320704 00000100:00100000:2.0:1788796659.547506:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959320448 00000100:00100000:2.0:1788796659.547509:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959320448 00000100:00100000:2.0:1788796659.547531:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788796659.547539:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959320704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796659.547581:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959320704:12345-0@lo:400:kworker.0 Request processed in 43us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796659.547587:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788796659.547598:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788796659.547603:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959320448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796659.547626:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959320448:12345-0@lo:400:kworker.0 Request processed in 23us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796659.547631:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788796659.547670:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959320704:0@lo:400:kworker.0 00000100:00080000:3.0:1788796659.547949:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788796659.547953:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788796659.548083:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788796659.548099:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788796659.548114:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959320448:0@lo:400:kworker.0 00000100:00100000:0.0:1788796659.548124:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2612f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959320064:0@lo:400:kworker.0 00000001:02000400:2.0:1788796660.009207:0:12263:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 11:57:39 (1788796659) 00010000:00010000:2.0:1788796660.062580:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796660.070498:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959320832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796660.070586:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796660.070909:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959320832 00000100:00100000:2.0:1788796660.070919:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959320832 00000100:00100000:2.0:1788796660.070969:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788796660.070980:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959320832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788796660.071025:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796660.071093:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959320832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796660.071100:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788796660.071153:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959320832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796660.103637:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796660.103687:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796660.103726:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796660.103792:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796660.103822:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796660.103852:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936241536 00000100:00100000:0.0:1788796660.103864:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936241536 00000100:00100000:0.0:1788796660.103932:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936241408 00000100:00100000:0.0:1788796660.103936:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936241408 00000100:00100000:0.0:1788796660.103966:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:0.0:1788796660.103977:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2356:x1875688936241536:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796660.104070:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2356:x1875688936241536:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 94us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796660.104092:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:0.0:1788796660.104111:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:0.0:1788796660.104118:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936241408:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796660.104143:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936241408:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796660.104150:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:0.0:1788796660.104169:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936241280 00000100:00100000:3.0:1788796660.104293:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936241152 00000100:00100000:3.0:1788796660.104298:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936241152 00000100:00100000:3.0:1788796660.104330:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 295 00000100:00100000:3.0:1788796660.104337:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2356:x1875688936241152:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796660.104363:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2356:x1875688936241152:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 27us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796660.104369:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 295 00000100:00080000:3.0:1788796660.104394:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788796660.104406:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788796660.104476:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936241664 00000100:00100000:1.0:1788796660.104480:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936241664 00000100:00100000:1.0:1788796660.104529:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 153 00000100:00100000:1.0:1788796660.104536:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936241664:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796660.104575:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936241664:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 39us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796660.104581:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 153 00000100:00100000:0.0:1788796660.104704:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936241280 00000100:00100000:0.0:1788796660.104772:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 154 00000100:00100000:0.0:1788796660.104780:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+14:2356:x1875688936241280:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796660.104811:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+14:2356:x1875688936241280:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 33us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796660.104816:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 154 00000100:00080000:3.0:1788796660.105020:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796661.023145:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796661.025512:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936241920 00000100:00100000:1.0:1788796661.025848:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936241920 00000100:00100000:1.0:1788796661.025999:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 136 00000100:00100000:1.0:1788796661.026009:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+14:11272:x1875688936241920:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788796661.026031:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796661.026052:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22f82 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eac1 expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026131:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22f89 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026146:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22f89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026160:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22f89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026173:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22f90 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026180:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22f90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026186:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22f90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026452:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22f97 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026469:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22f97 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026477:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22f97 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796661.026488:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788796661.026593:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22f89 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026601:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22f89 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026607:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22f89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026613:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796661.026616:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22f89 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026623:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22f89 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026635:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd24d5f1c00) 00010000:00010000:1.0:1788796661.026638:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796661.026642:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22f89 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026648:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22f89 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026659:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22f90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026669:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22f90 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026674:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22f90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026679:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796661.026681:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22f90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026687:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22f90 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026694:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bd255d57900) 00010000:00010000:1.0:1788796661.026697:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796661.026699:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22f90 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.026704:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22f90 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.027151:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22f82 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eac1 expref: 17 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.027168:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22f97 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eac1 expref: 16 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796661.027176:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:1.0:1788796661.027178:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796661.027187:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335c00, rc 0) 00000100:00100000:1.0:1788796661.027259:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+16:11272:x1875688936241920:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1251us (4124us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788796661.027267:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 136 00000100:00100000:0.0:1788796661.033805:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796661.033909:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936242048 00000100:00100000:2.0:1788796661.033921:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936242048 00000100:00100000:2.0:1788796661.033993:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:2.0:1788796661.034003:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd245991450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+16:2356:x1875688936242048:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796661.034018:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796661.034043:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22f97 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eac1 expref: 16 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796661.034063:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:2.0:1788796661.034069:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796661.034195:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd245991450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+15:2356:x1875688936242048:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 193us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796661.034203:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1788796661.036290:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796661.037084:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936242176 00000100:00100000:1.0:1788796661.037097:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936242176 00000100:00100000:1.0:1788796661.037228:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 137 00000100:00100000:1.0:1788796661.037239:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+15:11272:x1875688936242176:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788796661.048817:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+15:11272:x1875688936242176:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 Request processed in 11566us (12523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796661.048834:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 137 00010000:00010000:3.0:1788796661.082025:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796661.594568:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788796661.594595:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959320960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796661.594670:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796661.597537:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959320960 00000100:00100000:2.0:1788796661.597551:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959320960 00000100:00100000:2.0:1788796661.597613:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788796661.597623:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d419c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959320960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788796661.597662:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796661.597777:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d419c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959320960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (3106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796661.597784:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788796661.598036:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788796661.598094:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959320960:0@lo:13:osp-pre-0-0.0 00000020:00080000:2.0:1788796661.631466:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788796661.631516:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788796661.631528:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:2.0:1788796661.631625:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:3.0:1788796661.855920:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788796661.855935:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788796661.855984:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788796661.855991:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788796662.112957:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796663.131247:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796663.194571:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796663.194778:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936242304 00000100:00100000:1.0:1788796663.194789:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936242304 00000100:00100000:1.0:1788796663.194883:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 138 00000100:00100000:1.0:1788796663.194897:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+13:11314:x1875688936242304:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796663.194920:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796663.194945:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22fa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eac8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195020:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22fac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195034:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22fac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195046:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22fac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195063:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195077:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195084:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195368:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22fac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195377:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22fac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195385:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22fac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195392:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796663.195397:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22fac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195407:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22fac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195421:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1200) 00010000:00010000:1.0:1788796663.195424:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796663.195430:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22fac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195437:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22fac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195450:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195463:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fb3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195470:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195476:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796663.195480:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195487:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195496:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bd255d57a00) 00010000:00010000:1.0:1788796663.195498:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796663.195501:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fb3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195508:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195543:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22fa5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eac8 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195556:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1200) 00010000:00010000:1.0:1788796663.195559:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796663.195563:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22fa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eac8 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.195574:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334600, rc 0) 00000100:00100000:1.0:1788796663.195666:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+13:11314:x1875688936242304:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 773us (1106us total) trans 0 rc 301/301 00000100:00100000:1.0:1788796663.195691:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 138 00000100:00080000:2.0:1788796663.196312:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796663.210709:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796663.210809:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936242560 00000100:00100000:1.0:1788796663.210822:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936242560 00000100:00100000:1.0:1788796663.210901:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 139 00000100:00100000:1.0:1788796663.210915:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+13:11314:x1875688936242560:12345-192.168.201.25@tcp:36:lfs.0 00010000:00010000:1.0:1788796663.210975:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796663.211003:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5600/0xdd273c88cfe22931 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e908 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.211023:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24d5f1200) 00010000:00010000:1.0:1788796663.211037:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796663.211297:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22fba lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.211315:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22fba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.211329:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22fba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.211345:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22fc1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.211353:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.211361:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796663.212405:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788796663.212422:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22fba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.212432:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22fba lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.212441:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22fba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.212448:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796663.212453:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22fba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.212462:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22fba lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.212475:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd255d57f00) 00010000:00010000:1.0:1788796663.212479:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796663.212484:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22fba lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.212490:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe22fba lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788796663.212506:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000638b494f reply state 0000000003b7ebe9 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796663.212515:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788796663.212616:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+14:11314:x1875688936242560:12345-192.168.201.25@tcp:36:lfs.0 Request processed in 1703us (1915us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788796663.212637:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 139 00010000:00010000:2.0:1788796663.214886:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.214902:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22fc1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.214909:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22fc1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.214915:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335c00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796663.214919:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22fc1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.214927:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22fc1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.214942:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bd255d57400) 00010000:00010000:2.0:1788796663.214946:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796663.214951:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22fc1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.214957:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe22fc1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796663.341451:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796663.341540:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936242688 00000100:00100000:1.0:1788796663.341552:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936242688 00000100:00100000:1.0:1788796663.341618:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 140 00000100:00100000:1.0:1788796663.341630:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+13:11322:x1875688936242688:12345-192.168.201.25@tcp:101:lctl.0 00010000:00010000:1.0:1788796663.341656:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796663.341681:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22fc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eacf expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.341807:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.341833:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.341846:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796663.342406:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788796663.342412:0:10139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788796663.342439:0:10139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.342466:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22fc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eacf expref: 15 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.342483:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eacf expref: 14 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.342491:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd255d57f00) 00010000:00010000:2.0:1788796663.342494:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788796663.342497:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335a00, rc 0) 00000100:00100000:2.0:1788796663.342561:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+14:11322:x1875688936242688:12345-192.168.201.25@tcp:101:lctl.0 Request processed in 933us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796663.342569:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 140 00000100:00100000:0.0:1788796663.407996:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796663.408174:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936242816 00000100:00100000:1.0:1788796663.408197:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936242816 00000100:00100000:1.0:1788796663.408264:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 141 00000100:00100000:1.0:1788796663.408276:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+14:11328:x1875688936242816:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796663.408299:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796663.408325:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22fd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ead6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408398:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22fdd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408433:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22fdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408446:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22fdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408463:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22fe4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408471:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408477:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408584:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22feb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408592:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408599:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796663.408625:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788796663.408628:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796663.408645:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408656:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22fdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408671:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22fdd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408678:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22fdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408683:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796663.408688:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22fdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408694:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22fdd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408707:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd255d57f00) 00010000:00010000:1.0:1788796663.408710:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796663.408715:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22fdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408721:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe22fdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408737:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408743:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22fe4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408817:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408831:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796663.408841:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408848:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408856:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bd255d57a00) 00010000:00010000:1.0:1788796663.408858:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796663.408861:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22fe4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408867:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe22fe4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408902:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe22fd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ead6 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408916:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ead6 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.408922:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796663.408923:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788796663.408925:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335200, rc 0) 00000100:00100000:1.0:1788796663.408973:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+15:11328:x1875688936242816:12345-192.168.201.25@tcp:101:bash.0 Request processed in 701us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796663.408977:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 141 00000100:00100000:0.0:1788796663.412118:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796663.412259:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936243072 00000100:00100000:1.0:1788796663.412270:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936243072 00000100:00100000:1.0:1788796663.412334:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 142 00000100:00100000:1.0:1788796663.412345:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+15:11328:x1875688936243072:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796663.412393:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796663.412415:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22ff2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eadd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.412562:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22ff9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.412578:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.412591:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.412643:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23000 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.412651:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.412657:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788796663.413278:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788796663.413447:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23007 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.413458:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.413467:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.413513:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.413520:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22ff9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.413527:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22ff9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.413533:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796663.413537:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22ff9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.413545:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22ff9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.413558:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796663.413561:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796663.413566:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22ff9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.413573:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe22ff9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788796663.413588:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007edd70de reply state 00000000152b6d78 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796663.413597:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788796663.413626:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe22ff2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eadd expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.413654:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23007 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eadd expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.413661:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd255d57c00) 00010000:00010000:1.0:1788796663.413664:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796663.413666:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335c00, rc 0) 00000100:00100000:1.0:1788796663.413731:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+18:11328:x1875688936243072:12345-192.168.201.25@tcp:101:bash.0 Request processed in 1387us (1621us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788796663.413739:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 142 00010000:00010000:2.0:1788796663.417535:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.417554:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23000 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.417561:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23000 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.417567:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796663.417572:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23000 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.417595:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23000 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.417614:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd255d57000) 00010000:00010000:2.0:1788796663.417617:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796663.417623:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23000 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.417631:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23000 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796663.419632:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796663.420943:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936243200 00000100:00100000:2.0:1788796663.420959:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936243200 00000100:00100000:2.0:1788796663.421042:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:2.0:1788796663.421052:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2355:x1875688936243200:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1788796663.421072:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796663.421095:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23015 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eae4 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788796663.421123:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788796663.421143:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=390s v=(0 0) 00010000:00010000:2.0:1788796663.421148:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796663.421158:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eae4 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.421178:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eae4 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.421212:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6600, rc 0) 00000100:00100000:2.0:1788796663.421282:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2355:x1875688936243200:12345-192.168.201.25@tcp:101:bash.0 Request processed in 231us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796663.421289:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00080000:3.0:1788796663.421714:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788796663.426330:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796663.426465:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936243328 00000100:00100000:2.0:1788796663.426475:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936243328 00000100:00100000:2.0:1788796663.426534:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:2.0:1788796663.426544:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:11328:x1875688936243328:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1788796663.426562:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796663.426580:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eaeb expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.426609:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23015 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eae4 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.426616:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796663.426619:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796663.426622:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.426648:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eae4 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.426658:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eae4 expref: 7 pid: 6694 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796663.426686:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1875688959321088:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796663.426811:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a533b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788796663.430000:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796663.430221:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936243456 00000100:00100000:0.0:1788796663.430232:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936243456 00010000:00010000:0.0:1788796663.430274:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23015 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eae4 expref: 8 pid: 6694 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796663.430380:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:0.0:1788796663.430391:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267999180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+8:2357:x1875688936243456:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796663.430408:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788796663.430417:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1875688959321088:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796663.430432:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eae4 expref: 8 pid: 6694 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796663.430445:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eae4 expref: 8 pid: 6694 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.430455:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796663.430467:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23015 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eae4 expref: 8 pid: 6694 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.430471:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796663.430475:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796663.430483:0:6691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.430494:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796663.430954:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796663.431241:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267999180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936243456:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 846us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796663.431251:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00010000:00010000:3.0:1788796663.434174:0:6691:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796663.434202:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d89b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1875688959321216:192.168.201.25@tcp:105: 00000100:00100000:3.0:1788796663.434308:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a533b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788796663.436412:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d89b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1875688959321216:192.168.201.25@tcp:105: 00010000:00010000:3.0:1788796663.436436:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6c00, rc 0) 00000100:00100000:3.0:1788796663.436496:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:11328:x1875688936243328:12345-192.168.201.25@tcp:101:bash.0 Request processed in 9952us (10175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796663.436505:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:0.0:1788796663.439731:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796663.439934:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936243712 00000100:00100000:1.0:1788796663.439946:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936243712 00000100:00100000:1.0:1788796663.440174:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:1.0:1788796663.440188:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+17:11328:x1875688936243712:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:1.0:1788796663.440566:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+18:11328:x1875688936243712:12345-192.168.201.25@tcp:35:bash.0 Request processed in 379us (901us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788796663.440574:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:0.0:1788796663.518395:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796663.518536:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936243968 00000100:00100000:1.0:1788796663.518547:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936243968 00000100:00100000:1.0:1788796663.518608:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 143 00000100:00100000:1.0:1788796663.518619:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+18:11338:x1875688936243968:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796663.518647:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796663.518678:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23023 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eaf2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796663.518836:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788796663.518953:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23023 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaf2 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.518967:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd255d57f00) 00010000:00010000:1.0:1788796663.518971:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796663.518976:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23023 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaf2 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.518990:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335000, rc 0) 00000100:00100000:1.0:1788796663.519056:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+19:11338:x1875688936243968:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 439us (683us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1788796663.519063:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 143 00000100:00100000:0.0:1788796663.523476:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796663.523610:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936244224 00000100:00100000:2.0:1788796663.523620:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936244224 00000100:00100000:2.0:1788796663.523692:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:2.0:1788796663.523703:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+19:11338:x1875688936244224:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788796663.524085:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+20:11338:x1875688936244224:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 383us (618us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788796663.524094:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:0.0:1788796663.581685:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796663.581836:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936244352 00000100:00100000:2.0:1788796663.581848:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936244352 00000100:00100000:2.0:1788796663.581918:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 144 00000100:00100000:2.0:1788796663.581946:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+20:11344:x1875688936244352:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788796663.581981:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796663.582005:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23031 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eaf9 expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.582092:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23038 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.582108:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.582120:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796663.582157:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788796663.582160:0:10139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788796663.582178:0:10139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.582206:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23031 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaf9 expref: 22 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.582227:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaf9 expref: 21 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.582236:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:2.0:1788796663.582239:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788796663.582243:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6800, rc 0) 00000100:00100000:2.0:1788796663.582317:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+21:11344:x1875688936244352:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 374us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796663.582334:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 144 00000100:00100000:0.0:1788796663.591105:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796663.591283:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936244608 00000100:00100000:1.0:1788796663.591294:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936244608 00000100:00100000:1.0:1788796663.591359:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 145 00000100:00100000:1.0:1788796663.591469:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+21:11344:x1875688936244608:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796663.591496:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796663.591522:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2303f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb00 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.591636:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23046 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.591652:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.591743:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796663.591852:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788796663.591988:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2303f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb00 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.592006:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23046 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb00 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.592026:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd255d57c00) 00010000:00010000:1.0:1788796663.592030:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796663.592034:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334600, rc 0) 00000100:00100000:1.0:1788796663.592145:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+23:11344:x1875688936244608:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 777us (1053us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788796663.592152:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 145 00000100:00100000:0.0:1788796663.596039:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796663.596261:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936244864 00000100:00100000:2.0:1788796663.596271:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936244864 00000100:00100000:2.0:1788796663.596324:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 146 00000100:00100000:2.0:1788796663.596334:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+23:11344:x1875688936244864:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788796663.596358:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796663.596385:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23054 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb07 expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.596476:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe2305b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.596492:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe2305b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.596504:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe2305b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796663.596515:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788796663.596632:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23054 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb07 expref: 26 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.596650:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe2305b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb07 expref: 25 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.596659:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd255d57c00) 00010000:00010000:2.0:1788796663.596831:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788796663.596837:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6400, rc 0) 00000100:00100000:2.0:1788796663.596902:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+25:11344:x1875688936244864:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 570us (877us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788796663.596909:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 146 00000100:00100000:0.0:1788796663.602987:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796663.603133:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936244992 00000100:00100000:2.0:1788796663.603146:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936244992 00000100:00100000:2.0:1788796663.603220:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:2.0:1788796663.603231:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+25:2355:x1875688936244992:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796663.603247:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796663.603275:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23046 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb00 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.603296:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd255d57c00) 00010000:00010000:2.0:1788796663.603302:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796663.603382:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+24:2355:x1875688936244992:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 153us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796663.603389:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:0.0:1788796663.609687:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796663.610214:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936245120 00000100:00100000:2.0:1788796663.610226:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936245120 00000100:00100000:2.0:1788796663.610291:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:2.0:1788796663.610301:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+6:2358:x1875688936245120:12345-192.168.201.25@tcp:1:lfs.0 00010000:00010000:2.0:1788796663.610351:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000293cf3e6/0xdd273c88cfe23069 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.610429:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.610439:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796663.610458:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788796663.610463:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000293cf3e6/0xdd273c88cfe23069 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.610508:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.610525:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 6 pid: 6691 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796663.610544:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1875688959321344:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796663.611297:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a533480 going to sleep for 11 seconds 00000100:00100000:1.0:1788796663.616355:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796663.616501:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936245248 00000100:00100000:0.0:1788796663.616511:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936245248 00002000:00100000:0.0:1788796663.616573:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9bd267998a80 x1875688936245248/t0(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:89/0 lens 504/0 e 0 to 0 dl 1788796674 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788796663.616585:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd267998a80 with x1875688936245248 ext(0->12) 00010000:00010000:0.0:1788796663.616594:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 7 pid: 6691 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796663.616611:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 7 pid: 6691 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788796663.616620:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bd267998a80 00000100:00100000:0.0:1788796663.616658:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:0.0:1788796663.616677:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936245248:12345-192.168.201.25@tcp:4:lfs.0 00000100:00100000:0.0:1788796663.617245:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad2796a3-2145-47da-88fb-baa43721bec1+9:2357:x1875688936245248:12345-192.168.201.25@tcp:4:lfs.0 Request processed in 566us (896us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788796663.617253:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00002000:00100000:0.0:1788796663.617260:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9bd267998a80 x1875688936245248/t4294967305(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:89/0 lens 504/448 e 0 to 0 dl 1788796674 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788796663.617269:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd267998a80 with x1875688936245248 ext(0->12) 00010000:00010000:0.0:1788796663.617275:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 9 pid: 6691 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796663.617299:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 9 pid: 6691 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788796663.617307:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bd267998a80 00000100:00100000:2.0:1788796663.617980:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1875688959321344:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796663.618006:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000293cf3e6/0xdd273c88cfe23069 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796663.620645:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796663.620719:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936245376 00000100:00100000:0.0:1788796663.620729:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936245376 00010000:00010000:0.0:1788796663.620788:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 9 pid: 6691 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796663.620846:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:0.0:1788796663.620856:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+9:2357:x1875688936245376:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796663.620874:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788796663.620896:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788796663.620900:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788796664 00002000:00010000:0.0:1788796663.620902:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788796664 00002000:00010000:0.0:1788796663.620905:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788796664 00010000:00010000:0.0:1788796663.620912:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 9 pid: 6691 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796663.620926:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 9 pid: 6691 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796663.620953:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b871fbfd/0xdd273c88cfe2301c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaeb expref: 9 pid: 6691 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796663.620995:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788796663.621000:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788796663.621008:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000293cf3e6/0xdd273c88cfe23069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796663.621030:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000293cf3e6/0xdd273c88cfe23069 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796663.621060:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796663.621167:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000293cf3e6/0xdd273c88cfe23069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.621177:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000293cf3e6/0xdd273c88cfe23069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.621204:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000293cf3e6/0xdd273c88cfe23069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.621213:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000293cf3e6/0xdd273c88cfe23069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.621229:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000293cf3e6/0xdd273c88cfe23069 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.621236:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6e00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:1.0:1788796663.621241:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000293cf3e6/0xdd273c88cfe23069 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.621252:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000293cf3e6/0xdd273c88cfe23069 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.621265:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000293cf3e6/0xdd273c88cfe23069 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.621274:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000293cf3e6/0xdd273c88cfe23069 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796663.621940:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+8:2357:x1875688936245376:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 1079us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796663.621952:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:1.0:1788796663.622053:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936245120:12345-192.168.201.25@tcp:1:lfs.0 Request processed in 11752us (12387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796663.622062:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:0.0:1788796663.624926:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796663.624982:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936245632 00000100:00100000:2.0:1788796663.624992:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936245632 00000100:00100000:2.0:1788796663.625053:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:2.0:1788796663.625064:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2504d7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+24:11344:x1875688936245632:12345-192.168.201.25@tcp:35:lfs.0 00000004:00010000:2.0:1788796663.625139:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe2305b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb07 expref: 24 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788796663.625809:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788796663.625868:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788796663.626358:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788796663.626432:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23070 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.626449:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23007 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eadd expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.626458:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23070 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.626491:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23007 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eadd expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.626506:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23007 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eadd expref: 28 pid: 5845 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796663.626521:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d67800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875688959321472:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796663.627068:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796663.629140:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d67800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875688959321472:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796663.629168:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23070 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796663.631032:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796663.631541:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936245760 00000100:00100000:2.0:1788796663.631565:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936245760 00010000:00010000:2.0:1788796663.631616:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23007 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eadd expref: 29 pid: 5845 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796663.631659:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:2.0:1788796663.631675:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+29:2358:x1875688936245760:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796663.631690:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796663.631696:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23007 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eadd expref: 29 pid: 5845 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.631710:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23007 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eadd expref: 29 pid: 5845 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.631776:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23007 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eadd expref: 29 pid: 5845 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.631796:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd255d57c00) 00010000:00010000:2.0:1788796663.631802:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23070 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.631813:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23070 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.631830:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23070 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.631873:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796663.631930:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+28:2358:x1875688936245760:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 257us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796663.631938:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 62 00010000:00010000:3.0:1788796663.632097:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23070 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796663.632108:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23070 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788796663.632280:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788796663.632522:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1788796663.632661:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d898000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959321600:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788796663.632722:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796663.632800:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250ba16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796663.633280:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959321600 00000100:00100000:2.0:1788796663.633289:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959321600 00000100:00100000:2.0:1788796663.633354:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788796663.633363:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d89ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1875688959321600:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788796663.633441:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d89ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1875688959321600:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 78us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796663.633448:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788796663.634397:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788796663.634460:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d898000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959321600:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788796663.635241:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788796663.635333:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d898000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959321728:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788796663.635395:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796663.635479:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250ba1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788796663.636259:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959321728 00000100:00100000:2.0:1788796663.636270:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959321728 00000100:00100000:2.0:1788796663.636379:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788796663.636390:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1875688959321728:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788796663.636868:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1875688959321728:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 479us (1471us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788796663.636876:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788796663.637113:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d898000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959321728:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788796663.637185:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788796663.637233:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23070 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796663.637246:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23070 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796663.637254:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23070 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796663.637260:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796663.637266:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23070 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796663.637274:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23070 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796663.637300:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd255d57c00) 00010000:00010000:3.0:1788796663.637303:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788796663.637309:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23070 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796663.637316:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23070 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788796663.637981:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788796663.638209:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788796663.638220:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 390619472959ns, next at 391619471042ns, rc = 0 00000001:00080000:3.0:1788796663.638227:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788796663.638266:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd255d57c00) 00010000:00010000:3.0:1788796663.638270:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788796663.638278:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe2305b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb07 expref: 32 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796663.638436:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2504d7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+31:11344:x1875688936245632:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 13372us (13519us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788796663.638444:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00000020:00080000:3.0:1788796663.638450:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788796663.642109:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796663.642199:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936245888 00000100:00100000:2.0:1788796663.642210:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936245888 00000100:00100000:2.0:1788796663.642307:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 147 00000100:00100000:2.0:1788796663.642318:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+31:11344:x1875688936245888:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788796663.642343:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796663.642367:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23077 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb0e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.642861:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23077 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb0e expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.642882:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23077 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb0e expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.642905:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:2.0:1788796663.642908:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788796663.642913:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7600, rc 0) 00000100:00100000:2.0:1788796663.643034:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+32:11344:x1875688936245888:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 717us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796663.643042:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 147 00000100:00100000:2.0:1788796663.646248:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796663.646378:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936246144 00000100:00100000:1.0:1788796663.646390:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936246144 00000100:00100000:1.0:1788796663.646454:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:1.0:1788796663.646466:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+32:11344:x1875688936246144:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1788796663.646948:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+33:11344:x1875688936246144:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 483us (709us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788796663.646968:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:0.0:1788796663.729492:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796663.729606:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936246400 00000100:00100000:1.0:1788796663.729619:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936246400 00000100:00100000:1.0:1788796663.729700:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 148 00000100:00100000:1.0:1788796663.729710:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+33:11354:x1875688936246400:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796663.729736:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796663.729796:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2307e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb15 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796663.729902:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788796663.730038:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2307e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb15 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.730052:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd255d57f00) 00010000:00010000:1.0:1788796663.730055:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796663.730061:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2307e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb15 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.730076:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335000, rc 0) 00000100:00100000:1.0:1788796663.730136:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+34:11354:x1875688936246400:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 427us (657us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1788796663.730143:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 148 00000100:00100000:0.0:1788796663.737661:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796663.739069:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936246528 00000100:00100000:1.0:1788796663.739084:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936246528 00000100:00100000:1.0:1788796663.739211:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 149 00000100:00100000:1.0:1788796663.739223:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+34:11354:x1875688936246528:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:1.0:1788796663.739320:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2308c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739337:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2308c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739349:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2308c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739364:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23093 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739371:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739378:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739472:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2309a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739481:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2309a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739489:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2309a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788796663.739527:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2309a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739540:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2308c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739556:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2308c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739563:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2308c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739569:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796663.739574:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2308c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739582:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2308c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739594:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796663.739597:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796663.739602:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2308c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739608:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2308c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739622:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739629:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23093 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739635:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739640:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796663.739648:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739655:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23093 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739663:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd255d57a00) 00010000:00010000:1.0:1788796663.739665:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796663.739668:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23093 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739674:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23093 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739689:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2309a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739696:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2309a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739702:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2309a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739707:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335c00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796663.739709:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2309a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739715:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2309a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739721:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:1.0:1788796663.739723:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796663.739732:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2309a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.739738:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2309a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796663.739915:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+34:11354:x1875688936246528:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 693us (2264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796663.739922:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 149 00000100:00100000:0.0:1788796663.742930:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796663.743030:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936246784 00000100:00100000:3.0:1788796663.743041:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936246784 00000100:00100000:3.0:1788796663.743106:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:3.0:1788796663.743117:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+34:11354:x1875688936246784:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788796663.743360:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+35:11354:x1875688936246784:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 243us (439us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788796663.743396:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:3.0:1788796663.794730:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796663.794897:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936247040 00000100:00100000:1.0:1788796663.794909:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936247040 00000100:00100000:1.0:1788796663.794974:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 150 00000100:00100000:1.0:1788796663.794985:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+35:11357:x1875688936247040:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796663.795013:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796663.795038:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe230a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb1c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.795141:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.795157:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.795169:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.799619:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe230af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.799649:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe230af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.799687:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe230af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.799865:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe230b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.799875:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe230b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.799883:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe230b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796663.799897:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788796663.800011:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800020:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800027:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800033:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796663.800037:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800045:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800056:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796663.800060:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796663.800072:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800079:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800093:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe230af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800099:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe230af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800105:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe230af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800110:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796663.800112:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe230af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800118:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe230af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800127:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd255d57a00) 00010000:00010000:1.0:1788796663.800129:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796663.800132:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe230af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800138:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe230af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800271:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe230a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb1c expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800298:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe230b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb1c expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796663.800306:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:1.0:1788796663.800308:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796663.800311:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334600, rc 0) 00000100:00100000:1.0:1788796663.800547:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+37:11357:x1875688936247040:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 5562us (5828us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788796663.800557:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 150 00000100:00100000:0.0:1788796663.809735:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796663.810129:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936247168 00000100:00100000:2.0:1788796663.810139:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936247168 00000100:00100000:2.0:1788796663.810201:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 151 00000100:00100000:2.0:1788796663.810228:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+37:11357:x1875688936247168:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:2.0:1788796663.810303:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe230c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.810322:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe230c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.810336:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe230c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.810367:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe230c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.810376:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe230c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.810383:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe230c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.810390:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796663.810395:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe230c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.810402:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe230c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.810415:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:2.0:1788796663.810418:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788796663.810424:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe230c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796663.810430:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe230c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796663.810683:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+37:11357:x1875688936247168:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 456us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796663.810690:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 151 00000100:00100000:0.0:1788796663.813684:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796663.813796:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936247424 00000100:00100000:3.0:1788796663.813809:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936247424 00000100:00100000:3.0:1788796663.813868:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:3.0:1788796663.813878:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+37:11357:x1875688936247424:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788796663.814132:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+38:11357:x1875688936247424:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 254us (458us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788796663.814139:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:3.0:1788796664.088830:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796664.088959:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936247680 00000100:00100000:2.0:1788796664.088969:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936247680 00000100:00100000:2.0:1788796664.089028:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 152 00000100:00100000:2.0:1788796664.089040:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+38:11388:x1875688936247680:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:2.0:1788796664.089072:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796664.089092:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe230cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb23 expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.089179:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe230d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.089190:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe230d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.089203:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe230d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796664.089215:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788796664.089339:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe230cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb23 expref: 41 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.089361:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe230d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb23 expref: 40 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.089369:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:2.0:1788796664.089385:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788796664.089389:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7e00, rc 0) 00000100:00100000:2.0:1788796664.089443:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+40:11388:x1875688936247680:12345-192.168.201.25@tcp:101:cat.0 Request processed in 405us (633us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788796664.089450:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 152 00000100:00100000:1.0:1788796664.097428:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796664.097536:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936247936 00000100:00100000:3.0:1788796664.097547:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936247936 00000100:00100000:3.0:1788796664.097614:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:3.0:1788796664.097626:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+40:11388:x1875688936247936:12345-192.168.201.25@tcp:35:cat.0 00000100:00100000:3.0:1788796664.097924:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+41:11388:x1875688936247936:12345-192.168.201.25@tcp:35:cat.0 Request processed in 299us (506us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788796664.097933:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:0.0:1788796664.099266:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796664.099422:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936248064 00000100:00100000:3.0:1788796664.099430:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936248064 00000100:00100000:3.0:1788796664.099488:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:3.0:1788796664.099498:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+41:2356:x1875688936248064:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796664.099512:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796664.099539:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe230d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb23 expref: 41 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796664.099573:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:3.0:1788796664.099580:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796664.099631:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+40:2356:x1875688936248064:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 134us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796664.099638:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00010000:00010000:3.0:1788796664.154053:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796664.159023:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796664.161339:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936248320 00000100:00100000:1.0:1788796664.161356:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936248320 00000100:00100000:1.0:1788796664.161436:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 153 00000100:00100000:1.0:1788796664.161448:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+40:11394:x1875688936248320:12345-192.168.201.25@tcp:101:dd.0 00010000:00010000:1.0:1788796664.161476:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796664.161479:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788796664.161508:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23038 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaf9 expref: 40 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.161542:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796664.161548:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796664.161564:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe230e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb2a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.161662:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.161688:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe230b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb1c expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.161697:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.161733:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe230b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb1c expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.161796:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe230b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb1c expref: 40 pid: 5845 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796664.161820:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959321856:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788796664.161924:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb78300 going to sleep for 11 seconds 00000100:00100000:0.0:1788796664.164379:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959321856:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796664.164416:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796664.164887:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796664.164965:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936248448 00000100:00100000:2.0:1788796664.164973:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936248448 00010000:00010000:2.0:1788796664.165008:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe230b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb1c expref: 41 pid: 5845 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796664.165051:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:2.0:1788796664.165060:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+41:2358:x1875688936248448:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796664.165073:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796664.165079:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe230b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb1c expref: 41 pid: 5845 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.165092:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe230b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb1c expref: 41 pid: 5845 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.165114:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe230b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb1c expref: 41 pid: 5845 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.165130:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:2.0:1788796664.165134:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.165143:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.165167:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.165189:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796664.165237:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+40:2358:x1875688936248448:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 177us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796664.165244:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 63 00010000:00010000:1.0:1788796664.165778:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.165788:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796664.165808:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788796664.165974:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe230e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb2a expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.165996:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb2a expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.166004:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:1.0:1788796664.166013:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788796664.166016:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334400, rc 0) 00000100:00100000:1.0:1788796664.166052:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+40:11394:x1875688936248320:12345-192.168.201.25@tcp:101:dd.0 Request processed in 4607us (7043us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788796664.166059:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 153 00000100:00100000:0.0:1788796664.173525:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796664.173616:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936248704 00000100:00100000:1.0:1788796664.173629:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936248704 00000100:00100000:1.0:1788796664.173698:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 154 00000100:00100000:1.0:1788796664.173707:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+40:11394:x1875688936248704:12345-192.168.201.25@tcp:36:dd.0 00010000:00010000:1.0:1788796664.174045:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe230f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.174063:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe230f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.174076:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe230f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788796664.174128:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1788796664.174153:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef63472b reply state 000000002e10a196 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe230f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796664.174162:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788796664.174254:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+43:11394:x1875688936248704:12345-192.168.201.25@tcp:36:dd.0 Request processed in 546us (748us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788796664.174261:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 154 00000020:00080000:1.0:1788796664.174266:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788796664.175531:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe230f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.175543:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe230f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.175550:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe230f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.175556:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796664.175560:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe230f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.175566:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe230f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.175582:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:2.0:1788796664.175585:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796664.175590:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe230f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.175597:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe230f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796664.461100:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796664.461230:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936248832 00000100:00100000:2.0:1788796664.461241:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936248832 00000100:00100000:2.0:1788796664.461349:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 155 00000100:00100000:2.0:1788796664.461360:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+42:11408:x1875688936248832:12345-192.168.201.25@tcp:101:stat.0 00010000:00010000:2.0:1788796664.463558:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796664.463591:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe230fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb31 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.463669:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe23103 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.463685:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe23103 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.463698:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe23103 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.463718:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe2310a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.463724:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe2310a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.463731:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe2310a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.463855:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23111 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.463868:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb2a expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.463890:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23111 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.463928:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb2a expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.463945:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb2a expref: 43 pid: 5846 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796664.463961:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d67800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875688959321984:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796664.464091:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93300 going to sleep for 11 seconds 00000100:00100000:0.0:1788796664.470507:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796664.470607:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936249088 00000100:00100000:3.0:1788796664.470619:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936249088 00000100:00100000:3.0:1788796664.470687:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:3.0:1788796664.470698:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+44:5596:x1875688936249088:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788796664.471639:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d67800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875688959321984:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796664.471680:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23111 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796664.472500:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+45:5596:x1875688936249088:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 1798us (1998us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788796664.472513:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:3.0:1788796664.475012:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796664.475081:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936249216 00000100:00100000:1.0:1788796664.475093:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936249216 00010000:00010000:1.0:1788796664.475139:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb2a expref: 45 pid: 5846 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796664.475200:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:1.0:1788796664.475210:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd245992450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+45:2357:x1875688936249216:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788796664.475225:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796664.475233:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb2a expref: 45 pid: 5846 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.475248:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb2a expref: 45 pid: 5846 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.475271:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe230e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb2a expref: 45 pid: 5846 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.475285:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:1.0:1788796664.475291:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23111 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.475301:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.475309:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23111 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.475403:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796664.475459:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd245992450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+44:2357:x1875688936249216:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 249us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796664.475467:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00010000:00010000:2.0:1788796664.476438:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.476451:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796664.476498:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788796664.476503:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788796664.476525:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.476541:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477100:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe23103 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477110:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe23103 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477118:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe23103 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477126:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796664.477131:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe23103 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477140:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe23103 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477155:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:2.0:1788796664.477158:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796664.477163:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe23103 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477170:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe23103 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477188:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe2310a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477195:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe2310a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477201:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe2310a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477217:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796664.477220:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe2310a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477227:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe2310a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477236:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd24d573f00) 00010000:00010000:2.0:1788796664.477239:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796664.477242:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe2310a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477248:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe2310a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477295:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe230fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb31 expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477311:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23111 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb31 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.477319:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:2.0:1788796664.477321:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788796664.477324:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6a00, rc 0) 00000100:00100000:2.0:1788796664.478181:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+43:11408:x1875688936248832:12345-192.168.201.25@tcp:101:stat.0 Request processed in 16817us (17086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796664.478192:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 155 00000100:00100000:3.0:1788796664.529192:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796664.529526:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936249472 00000100:00100000:1.0:1788796664.529553:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936249472 00000100:00100000:1.0:1788796664.529623:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 156 00000100:00100000:1.0:1788796664.529635:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+43:11414:x1875688936249472:12345-192.168.201.25@tcp:36:truncate.0 00010000:00010000:1.0:1788796664.529711:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796664.529739:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23111 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb31 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.529798:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:1.0:1788796664.529814:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796664.530055:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23118 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.530070:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.530081:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788796664.530135:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1788796664.530161:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa7faa9b reply state 00000000d30e3585 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796664.530170:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788796664.530276:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+45:11414:x1875688936249472:12345-192.168.201.25@tcp:36:truncate.0 Request processed in 642us (1095us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1788796664.530284:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 156 00000020:00080000:1.0:1788796664.530288:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788796664.532434:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.532476:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23118 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.532485:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23118 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.532491:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796664.532496:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23118 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.532503:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23118 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.532521:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:2.0:1788796664.532525:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796664.532531:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23118 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.532537:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23118 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796664.666097:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788796664.666564:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959322368:0@lo:400:kworker.0 00000100:00100000:2.0:1788796664.666659:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796664.666733:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788796664.666741:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959322240:0@lo:400:kworker.0 00000100:00100000:2.0:1788796664.666791:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796664.666839:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959322368 00000100:00100000:2.0:1788796664.666849:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959322368 00000100:00100000:2.0:1788796664.666901:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959322240 00000100:00100000:2.0:1788796664.666904:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959322240 00000100:00100000:2.0:1788796664.666949:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788796664.666958:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959322368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796664.667013:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959322368:12345-0@lo:400:kworker.0 Request processed in 57us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796664.667020:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788796664.667036:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788796664.667042:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959322240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796664.667069:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959322240:12345-0@lo:400:kworker.0 Request processed in 27us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796664.667076:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788796664.667112:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959322240:0@lo:400:kworker.0 00000100:00100000:2.0:1788796664.667126:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959322368:0@lo:400:kworker.0 00000100:00080000:2.0:1788796664.667179:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796664.670666:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959322496:0@lo:400:kworker.0 00000100:00100000:3.0:1788796664.670737:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796664.670822:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959322112:0@lo:400:kworker.0 00000100:00100000:3.0:1788796664.670856:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796664.670863:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959322496 00000100:00100000:0.0:1788796664.670874:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959322496 00000100:00100000:3.0:1788796664.670919:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959322112 00000100:00100000:3.0:1788796664.670925:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959322112 00000100:00100000:0.0:1788796664.670944:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788796664.670955:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959322496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796664.670957:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788796664.670968:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959322112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796664.671018:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959322496:12345-0@lo:400:kworker.0 Request processed in 67us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796664.671025:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788796664.671047:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796664.671125:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959322112:12345-0@lo:400:kworker.0 Request processed in 159us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796664.671132:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788796664.671178:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959322496:0@lo:400:kworker.0 00000100:00100000:3.0:1788796664.671188:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959322112:0@lo:400:kworker.0 00000100:00100000:1.0:1788796664.671790:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788796664.671814:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959322752:0@lo:400:kworker.0 00000100:00100000:1.0:1788796664.671853:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796664.672022:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959322624:0@lo:400:kworker.0 00000100:00100000:0.0:1788796664.672056:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796664.672100:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959322752 00000100:00100000:0.0:1788796664.672106:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959322752 00000100:00100000:0.0:1788796664.672141:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788796664.672149:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875688959322752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796664.672193:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875688959322752:12345-0@lo:400:kworker.0 Request processed in 45us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796664.672199:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788796664.672232:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959322752:0@lo:400:kworker.0 00000100:00100000:1.0:1788796664.672383:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959322624 00000100:00100000:1.0:1788796664.672389:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959322624 00000100:00100000:1.0:1788796664.672607:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788796664.672616:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959322624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796664.672669:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959322624:12345-0@lo:400:kworker.0 Request processed in 55us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796664.672675:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788796664.672819:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959322624:0@lo:400:kworker.0 00000100:00080000:0.0:1788796664.672837:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796664.673066:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796664.673161:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936249600 00000100:00100000:1.0:1788796664.673166:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936249600 00000100:00100000:1.0:1788796664.673235:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 157 00000100:00100000:1.0:1788796664.673242:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+44:11428:x1875688936249600:12345-192.168.201.25@tcp:101:stat.0 00010000:00010000:1.0:1788796664.673262:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796664.673283:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2311f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb38 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673346:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23126 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673360:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673534:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673552:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2312d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673560:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2312d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673567:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2312d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673722:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673732:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673739:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796664.673881:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788796664.673886:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796664.673903:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673914:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673922:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673929:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23126 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673935:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673941:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796664.673946:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673953:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23126 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673970:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796664.673973:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796664.673979:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23126 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.673985:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.674064:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2312d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.674072:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2312d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.674077:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2312d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.674082:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796664.674085:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2312d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.674092:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2312d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.674099:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd255d57a00) 00010000:00010000:1.0:1788796664.674102:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796664.674105:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2312d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.674111:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2312d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.674154:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2311f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb38 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.674167:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb38 expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.674175:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:1.0:1788796664.674177:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796664.674179:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335000, rc 0) 00000100:00100000:1.0:1788796664.674271:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+45:11428:x1875688936249600:12345-192.168.201.25@tcp:101:stat.0 Request processed in 1028us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796664.674277:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 157 00000100:00100000:0.0:1788796664.738252:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796664.738343:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936249856 00000100:00100000:1.0:1788796664.738354:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936249856 00000100:00100000:1.0:1788796664.738437:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 158 00000100:00100000:1.0:1788796664.738447:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+45:11438:x1875688936249856:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796664.738470:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796664.738493:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2313b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb3f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796664.738585:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788796664.738709:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2313b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb3f expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.738723:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd255d57f00) 00010000:00010000:1.0:1788796664.738726:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796664.738781:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2313b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb3f expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.738797:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335e00, rc 0) 00000100:00100000:1.0:1788796664.738888:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+46:11438:x1875688936249856:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 442us (644us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788796664.738896:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 158 00000100:00100000:0.0:1788796664.741284:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796664.741468:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936250112 00000100:00100000:3.0:1788796664.741479:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936250112 00000100:00100000:3.0:1788796664.741538:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:3.0:1788796664.741548:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2504d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+46:11438:x1875688936250112:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788796664.741961:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2504d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+47:11438:x1875688936250112:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 413us (681us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788796664.741969:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:3.0:1788796664.804241:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796664.804343:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936250368 00000100:00100000:2.0:1788796664.804354:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936250368 00000100:00100000:2.0:1788796664.804438:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 159 00000100:00100000:2.0:1788796664.804449:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+47:11444:x1875688936250368:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1788796664.804480:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796664.804507:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe23149 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb46 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.804609:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.804639:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23134 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb38 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.804659:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.804694:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb38 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.804707:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb38 expref: 48 pid: 5846 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796664.804721:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875688959322880:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796664.804859:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93840 going to sleep for 11 seconds 00000100:00100000:0.0:1788796664.814063:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796664.814162:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936250496 00000100:00100000:1.0:1788796664.814173:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936250496 00010000:00010000:1.0:1788796664.814221:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23134 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb38 expref: 49 pid: 5846 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796664.814265:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:1.0:1788796664.814275:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+49:2357:x1875688936250496:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788796664.814290:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796664.814296:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23134 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb38 expref: 49 pid: 5846 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.814309:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb38 expref: 49 pid: 5846 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.814332:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:1.0:1788796664.814338:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.814347:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.814355:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.814418:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796664.814488:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+49:2357:x1875688936250496:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 213us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796664.814496:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 65 00010000:00010000:2.0:1788796664.815617:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb38 expref: 48 pid: 5846 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796664.815704:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875688959322880:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796664.815733:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.815841:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.815848:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796664.815870:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788796664.816068:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe23149 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb46 expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.816085:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb46 expref: 48 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.816093:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:2.0:1788796664.816097:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788796664.816100:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7200, rc 0) 00000100:00100000:2.0:1788796664.816160:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+48:11444:x1875688936250368:12345-192.168.201.25@tcp:101:bash.0 Request processed in 11712us (11927us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788796664.816167:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 159 00000100:00100000:0.0:1788796664.819587:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796664.819666:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936250752 00000100:00100000:1.0:1788796664.819676:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936250752 00000100:00100000:1.0:1788796664.819734:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 160 00000100:00100000:1.0:1788796664.819761:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+48:11444:x1875688936250752:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:1.0:1788796664.820087:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2315e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.820102:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2315e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.820114:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2315e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788796664.820161:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1788796664.820183:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cba81db reply state 00000000fc2db9ff transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2315e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796664.820191:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788796664.820324:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+51:11444:x1875688936250752:12345-192.168.201.25@tcp:36:bash.0 Request processed in 580us (744us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788796664.820331:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 160 00000020:00080000:1.0:1788796664.820335:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788796664.827159:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2315e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.827179:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2315e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.827186:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2315e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.827192:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796664.827206:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2315e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.827215:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2315e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.827232:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:2.0:1788796664.827235:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796664.827255:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2315e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796664.827261:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe2315e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796664.828267:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796664.828534:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936250880 00000100:00100000:1.0:1788796664.828546:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936250880 00000100:00100000:1.0:1788796664.828614:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 161 00000100:00100000:1.0:1788796664.828636:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+50:11444:x1875688936250880:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796664.828661:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796664.828681:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23165 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb4d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.828796:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2316c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.828824:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb46 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.828832:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2316c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.828866:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb46 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.828880:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb46 expref: 51 pid: 5845 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796664.828894:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959323008:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788796664.828977:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb78300 going to sleep for 11 seconds 00000100:00100000:0.0:1788796664.832201:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796664.832359:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959323008:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796664.832409:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2316c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796664.832626:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936251008 00000100:00100000:3.0:1788796664.832634:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936251008 00010000:00010000:3.0:1788796664.832677:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb46 expref: 52 pid: 5845 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796664.832782:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 66 00000100:00100000:3.0:1788796664.832793:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+52:2357:x1875688936251008:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796664.832822:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796664.832830:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb46 expref: 52 pid: 5845 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796664.832843:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb46 expref: 52 pid: 5845 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796664.832865:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23150 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb46 expref: 52 pid: 5845 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796664.832897:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:3.0:1788796664.832902:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2316c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796664.832912:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2316c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796664.832920:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2316c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796664.832938:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796664.832994:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+51:2357:x1875688936251008:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 203us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796664.833001:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 66 00010000:00010000:1.0:1788796664.833048:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2316c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.833065:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2316c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796664.833112:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788796664.833116:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796664.833135:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2316c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.833168:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23165 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb4d expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.833185:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2316c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb4d expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.833192:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:1.0:1788796664.833194:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796664.833197:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334e00, rc 0) 00000100:00100000:1.0:1788796664.833240:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+50:11444:x1875688936250880:12345-192.168.201.25@tcp:101:bash.0 Request processed in 4607us (4980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796664.833246:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 161 00000100:00100000:0.0:1788796664.836072:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796664.836157:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936251264 00000100:00100000:1.0:1788796664.836166:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936251264 00000100:00100000:1.0:1788796664.836217:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:1.0:1788796664.836231:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+50:11444:x1875688936251264:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:1.0:1788796664.836633:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+51:11444:x1875688936251264:12345-192.168.201.25@tcp:35:bash.0 Request processed in 402us (570us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788796664.836641:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:2.0:1788796664.929103:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796664.929186:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936251520 00000100:00100000:1.0:1788796664.929197:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936251520 00000100:00100000:1.0:1788796664.929261:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 162 00000100:00100000:1.0:1788796664.929271:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+51:11454:x1875688936251520:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796664.929298:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796664.929319:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23173 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb54 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796664.929423:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788796664.929552:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23173 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb54 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.929567:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd255d57f00) 00010000:00010000:1.0:1788796664.929570:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796664.929575:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe23173 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb54 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.929589:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334400, rc 0) 00000100:00100000:1.0:1788796664.929654:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+52:11454:x1875688936251520:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 384us (560us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1788796664.929662:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 162 00000100:00100000:2.0:1788796664.933140:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796664.933435:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936251648 00000100:00100000:1.0:1788796664.933446:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936251648 00000100:00100000:1.0:1788796664.933535:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 163 00000100:00100000:1.0:1788796664.933546:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+52:11454:x1875688936251648:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:1.0:1788796664.933870:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe23181 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.933917:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe23181 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.933929:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe23181 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.933945:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23188 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.933952:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.933958:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934054:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2318f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934062:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2318f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934069:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2318f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788796664.934112:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2318f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934125:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe23181 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934132:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe23181 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934149:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe23181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934156:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796664.934160:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe23181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934169:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe23181 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934181:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796664.934185:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796664.934189:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe23181 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934195:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe23181 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934208:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934214:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23188 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934219:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934224:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796664.934227:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934243:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23188 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934252:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd255d57a00) 00010000:00010000:1.0:1788796664.934254:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796664.934257:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23188 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934263:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23188 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934541:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2318f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934547:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2318f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934553:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2318f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934557:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335c00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796664.934560:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2318f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934566:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2318f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934573:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:1.0:1788796664.934575:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796664.934578:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2318f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796664.934593:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe2318f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796664.934732:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+52:11454:x1875688936251648:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 1185us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796664.934741:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 163 00000100:00100000:0.0:1788796664.956022:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796664.956134:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936251904 00000100:00100000:2.0:1788796664.956144:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936251904 00000100:00100000:2.0:1788796664.956206:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:2.0:1788796664.956218:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+52:11454:x1875688936251904:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788796664.956473:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+53:11454:x1875688936251904:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 252us (458us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788796664.956481:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:2.0:1788796665.003882:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796665.003963:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936252160 00000100:00100000:1.0:1788796665.003976:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936252160 00000100:00100000:1.0:1788796665.004057:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 164 00000100:00100000:1.0:1788796665.004068:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+53:11457:x1875688936252160:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796665.004098:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796665.004122:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23196 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb5b expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004210:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe2319d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004226:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe2319d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788796665.004227:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788796665.004242:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe2319d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004259:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe231a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004266:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe231a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004294:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe231a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004432:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004442:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004449:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796665.004459:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788796665.004569:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe2319d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004577:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe2319d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004582:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe2319d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004588:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796665.004593:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe2319d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004600:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe2319d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004613:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796665.004616:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796665.004627:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe2319d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004634:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe2319d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004650:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe231a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004657:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe231a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004663:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe231a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004667:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796665.004670:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe231a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004676:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe231a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004682:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd255d57a00) 00010000:00010000:1.0:1788796665.004685:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796665.004687:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe231a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004693:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe231a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004737:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23196 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb5b expref: 56 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004834:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb5b expref: 55 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.004843:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:1.0:1788796665.004845:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796665.004848:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334400, rc 0) 00000100:00100000:1.0:1788796665.004928:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+55:11457:x1875688936252160:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 861us (1056us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788796665.004936:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 164 00000100:00100000:0.0:1788796665.009767:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796665.009977:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936252288 00000100:00100000:2.0:1788796665.009988:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936252288 00000100:00100000:2.0:1788796665.010057:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 165 00000100:00100000:2.0:1788796665.010066:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+55:11457:x1875688936252288:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:2.0:1788796665.010134:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe231b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.010150:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe231b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.010161:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe231b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.010185:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe231b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.010208:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe231b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.010215:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe231b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.010222:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796665.010227:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe231b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.010234:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe231b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.010246:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:2.0:1788796665.010249:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788796665.010254:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe231b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.010260:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe231b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796665.010553:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+55:11457:x1875688936252288:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 486us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796665.010561:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 165 00000100:00100000:2.0:1788796665.012719:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796665.012939:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936252416 00000100:00100000:1.0:1788796665.012950:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936252416 00000100:00100000:1.0:1788796665.013025:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:1.0:1788796665.013035:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+55:2357:x1875688936252416:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788796665.013051:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796665.013078:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb5b expref: 55 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.013099:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:1.0:1788796665.013104:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796665.013150:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+54:2357:x1875688936252416:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 117us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796665.013157:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:0.0:1788796665.019576:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796665.019652:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936252672 00000100:00100000:1.0:1788796665.019664:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936252672 00000100:00100000:1.0:1788796665.019731:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:1.0:1788796665.019759:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+54:11457:x1875688936252672:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1788796665.020117:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+55:11457:x1875688936252672:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 360us (550us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788796665.020123:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:3.0:1788796665.163338:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796665.163683:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936252928 00000100:00100000:2.0:1788796665.163693:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936252928 00000100:00100000:2.0:1788796665.163869:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 166 00000100:00100000:2.0:1788796665.163883:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+55:11475:x1875688936252928:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:2.0:1788796665.163930:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796665.163952:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe231c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb62 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.164066:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe231c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.164082:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe231c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.164096:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe231c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796665.164109:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788796665.164237:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe231c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb62 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.164256:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe231c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb62 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.164265:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:2.0:1788796665.164268:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788796665.164272:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6600, rc 0) 00000100:00100000:2.0:1788796665.164339:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+57:11475:x1875688936252928:12345-192.168.201.25@tcp:101:cat.0 Request processed in 460us (1011us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788796665.164346:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 166 00000004:00080000:2.0:1788796665.177955:0:7928:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 392159205675ns, next at 393159203192ns, rc = 0 00000100:00100000:0.0:1788796665.178269:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959323136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796665.178337:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796665.178600:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959323136 00000100:00100000:3.0:1788796665.178611:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959323136 00000100:00100000:3.0:1788796665.178685:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788796665.178696:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875688959323136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788796665.178729:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796665.178810:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875688959323136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796665.178817:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:2.0:1788796665.179023:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788796665.179267:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788796665.179306:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959323136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796665.195326:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796665.195802:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936253056 00000100:00100000:1.0:1788796665.195815:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936253056 00000100:00100000:1.0:1788796665.195890:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00100000:1.0:1788796665.195901:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+57:11476:x1875688936253056:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796665.195932:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796665.195957:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.196041:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe231dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.196056:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe231dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.196069:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe231dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796665.196103:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788796665.196106:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796665.196124:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe231dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.196149:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb69 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.196188:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe231dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb69 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.196197:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796665.196201:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788796665.196204:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335c00, rc 0) 00000100:00100000:1.0:1788796665.196271:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+58:11476:x1875688936253056:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 371us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796665.196278:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00100000:0.0:1788796665.202209:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796665.202310:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936253440 00000100:00100000:1.0:1788796665.202320:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936253440 00000100:00100000:1.0:1788796665.202387:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:1.0:1788796665.202398:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+58:11476:x1875688936253440:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1788796665.202976:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+59:11476:x1875688936253440:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 577us (775us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788796665.202984:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:3.0:1788796665.207025:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796665.207248:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936253568 00000100:00100000:0.0:1788796665.207260:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936253568 00000100:00100000:0.0:1788796665.207327:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:0.0:1788796665.207338:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+59:11476:x1875688936253568:12345-192.168.201.25@tcp:103:lfs.0 00010000:00010000:0.0:1788796665.207354:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788796665.207395:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2316c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb4d expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796665.207444:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe231c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb62 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796665.207459:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23077 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb0e expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796665.207469:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573c00) 00010000:00010000:0.0:1788796665.207482:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796665.207550:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+56:11476:x1875688936253568:12345-192.168.201.25@tcp:103:lfs.0 Request processed in 212us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796665.207557:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:0.0:1788796665.211048:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796665.211467:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936253696 00000100:00100000:1.0:1788796665.211478:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936253696 00000100:00100000:1.0:1788796665.211546:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 168 00000100:00100000:1.0:1788796665.211559:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+56:11476:x1875688936253696:12345-192.168.201.25@tcp:58:lfs.0 00010000:00010000:1.0:1788796665.211685:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.211703:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.211738:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788796665.212011:0:10139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788796665.212116:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+56:11476:x1875688936253696:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 559us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796665.212124:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 168 00000100:00100000:2.0:1788796665.221801:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796665.221862:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796665.221900:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796665.221932:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796665.222094:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936253824 00000100:00100000:3.0:1788796665.222105:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936253824 00000100:00100000:3.0:1788796665.222164:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 297 00000100:00100000:3.0:1788796665.222174:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936253824:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796665.222255:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936253824:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 81us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796665.222263:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 297 00000100:00100000:0.0:1788796665.222413:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936253952 00000100:00100000:0.0:1788796665.222418:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936253952 00000100:00100000:0.0:1788796665.222467:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936254080 00000100:00100000:0.0:1788796665.222470:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936254080 00000100:00100000:0.0:1788796665.222492:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:0.0:1788796665.222500:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+6:2358:x1875688936253952:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796665.222531:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+6:2358:x1875688936253952:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 31us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796665.222538:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:0.0:1788796665.222551:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 91 00000100:00100000:0.0:1788796665.222557:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936254080:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796665.222584:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936254080:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 26us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796665.222599:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 91 00000100:00080000:3.0:1788796665.223199:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788796665.223205:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788796665.223265:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936254208 00000100:00100000:1.0:1788796665.223274:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936254208 00000100:00100000:1.0:1788796665.223334:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 158 00000100:00100000:1.0:1788796665.223343:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2358:x1875688936254208:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796665.223396:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2358:x1875688936254208:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 54us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796665.223402:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 158 00000100:00080000:3.0:1788796665.223493:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796665.243920:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796665.244113:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936254336 00000100:00100000:1.0:1788796665.244125:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936254336 00000100:00100000:1.0:1788796665.244188:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 169 00000100:00100000:1.0:1788796665.244199:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+56:11478:x1875688936254336:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796665.244222:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796665.244244:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe231ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb70 expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244314:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe231f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244329:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe231f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244357:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe231f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244527:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe231f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244537:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe231f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244545:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe231f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244650:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe231ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244659:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe231ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244666:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe231ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796665.244703:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788796665.244708:0:10139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796665.244727:0:10139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe231ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244738:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe231ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244784:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe231f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244815:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe231f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244822:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe231f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244838:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796665.244843:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe231f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244851:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe231f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244864:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796665.244868:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796665.244873:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe231f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244878:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe231f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244893:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe231f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244899:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe231f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244905:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe231f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244910:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796665.244919:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe231f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244927:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe231f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244935:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd255d57800) 00010000:00010000:1.0:1788796665.244938:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796665.244941:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe231f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244947:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe231f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.244982:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe231ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb70 expref: 58 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.245469:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe231ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb70 expref: 57 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796665.245477:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd255d57a00) 00010000:00010000:1.0:1788796665.245479:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788796665.245482:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335e00, rc 0) 00000100:00100000:1.0:1788796665.245557:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+57:11478:x1875688936254336:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1359us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796665.245566:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 169 00000040:00080000:3.0:1788796665.946251:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788796665.946262:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788796665.946316:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788796665.946323:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788796665.946464:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d899180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1875688959323264:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788796665.946570:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27257cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788796665.971644:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796665.971761:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936254464 00000100:00100000:0.0:1788796665.971771:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936254464 00000100:00100000:0.0:1788796665.971833:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 170 00000100:00100000:0.0:1788796665.971849:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+58:11490:x1875688936254464:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788796665.971878:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788796665.971970:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+58:11490:x1875688936254464:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 122us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796665.971977:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 170 00000100:00100000:3.0:1788796665.972510:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d899180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1875688959323264:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788796665.976464:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796665.976519:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936254592 00000100:00100000:2.0:1788796665.976530:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936254592 00000100:00100000:2.0:1788796665.976593:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 171 00000100:00100000:2.0:1788796665.976604:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+57:11490:x1875688936254592:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788796665.976694:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23206 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976711:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23206 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976723:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23206 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976738:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2320d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976766:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2320d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976774:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2320d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976818:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe23214 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976826:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe23214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976843:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe23214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796665.976883:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788796665.976887:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788796665.976899:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe23214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976910:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23206 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976916:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23206 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976923:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23206 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976929:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796665.976933:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23206 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976940:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23206 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976951:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:2.0:1788796665.976954:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796665.976959:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23206 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976965:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23206 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976986:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2320d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976992:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2320d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.976997:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2320d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.977002:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796665.977005:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2320d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.977011:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2320d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.977019:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9bd24d573f00) 00010000:00010000:2.0:1788796665.977022:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796665.977025:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2320d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.977031:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2320d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.977045:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe23214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.977051:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe23214 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.977056:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe23214 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.977069:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796665.977072:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe23214 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.977078:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe23214 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.977086:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd255d57a00) 00010000:00010000:2.0:1788796665.977088:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796665.977091:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe23214 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796665.977097:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe23214 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796665.977182:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+57:11490:x1875688936254592:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 Request processed in 578us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796665.977189:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 171 00000100:00100000:0.0:1788796665.983499:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796665.983636:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936254848 00000100:00100000:3.0:1788796665.983647:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936254848 00000100:00100000:3.0:1788796665.983732:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 172 00000100:00100000:3.0:1788796665.983768:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+57:11490:x1875688936254848:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788796665.983804:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796665.983828:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe2321b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb77 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796665.983941:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23222 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796665.983956:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796665.983967:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796665.983990:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788796665.984101:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796665.984110:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23222 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796665.984117:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796665.984123:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796665.984128:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796665.984137:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23222 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796665.984154:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd255d57a00) 00010000:00010000:3.0:1788796665.984158:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788796665.984165:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23222 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796665.984172:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23222 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796665.984219:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe2321b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb77 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796665.984231:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:3.0:1788796665.984234:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788796665.984245:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe2321b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb77 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796665.984258:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20200, rc 0) 00000100:00100000:3.0:1788796665.984343:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+58:11490:x1875688936254848:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 602us (852us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788796665.984351:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 172 00000100:00100000:0.0:1788796665.989240:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796665.989336:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936254976 00000100:00100000:1.0:1788796665.989347:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936254976 00000100:00100000:1.0:1788796665.989410:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 173 00000100:00100000:1.0:1788796665.989431:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+58:11490:x1875688936254976:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788796665.989469:0:10139:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788796665.989575:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+58:11490:x1875688936254976:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 145us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796665.989583:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 173 00000100:00100000:2.0:1788796665.995371:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796665.996175:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936255232 00000100:00100000:0.0:1788796665.996186:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936255232 00000100:00100000:0.0:1788796665.996245:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 174 00000100:00100000:0.0:1788796665.996256:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+58:11490:x1875688936255232:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788796665.996288:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796665.996292:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788796665.996321:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe231dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb69 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796665.996341:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:0.0:1788796665.996348:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788796665.996363:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23230 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb7e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788796665.999444:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788796665.999722:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe23237 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796665.999739:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe23237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796665.999776:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe23237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796665.999858:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23230 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb7e expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796665.999877:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe23237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb7e expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796665.999887:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:0.0:1788796665.999890:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788796665.999893:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5000, rc 0) 00000100:00100000:0.0:1788796665.999968:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+59:11490:x1875688936255232:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 3713us (4606us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788796665.999977:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 174 00000100:00100000:0.0:1788796666.007724:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796666.007870:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936255488 00000100:00100000:3.0:1788796666.007880:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936255488 00000100:00100000:3.0:1788796666.007941:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 175 00000100:00100000:3.0:1788796666.007951:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+59:11490:x1875688936255488:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788796666.008012:0:10139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796666.008038:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe23237 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb7e expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008059:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd24d5f1800) 00010000:00010000:3.0:1788796666.008069:0:10139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788796666.008091:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe23245 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008104:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe23245 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008113:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe23245 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008183:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe2324c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xcb51ede bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008191:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe2324c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb51ede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008212:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe2324c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb51ede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008292:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe23245 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008300:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe23245 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008306:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe23245 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008312:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796666.008316:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe23245 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008323:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe23245 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008332:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:3.0:1788796666.008334:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796666.008338:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe23245 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008344:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe23245 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008356:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe2324c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb51ede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008362:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe2324c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb51ede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008374:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe2324c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb51ede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008380:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796666.008383:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe2324c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb51ede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008389:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe2324c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcb51ede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008397:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xcb51ede (ffff9bd24712b100) 00010000:00010000:3.0:1788796666.008400:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796666.008403:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe2324c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xcb51ede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.008409:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe2324c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xcb51ede bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796666.008494:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+58:11490:x1875688936255488:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 544us (779us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788796666.008503:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 175 00000100:00100000:0.0:1788796666.014942:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796666.015030:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936255616 00000100:00100000:3.0:1788796666.015041:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936255616 00000100:00100000:3.0:1788796666.015098:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 176 00000100:00100000:3.0:1788796666.015108:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+58:11490:x1875688936255616:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788796666.015128:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796666.015152:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe23253 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb85 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.015213:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe2325a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.015226:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe2325a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.015237:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe2325a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.015330:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe23253 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb85 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.015347:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe2325a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb85 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.015355:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:3.0:1788796666.015359:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788796666.015362:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20600, rc 0) 00000100:00100000:3.0:1788796666.015418:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+59:11490:x1875688936255616:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 311us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796666.015425:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 176 00000100:00100000:3.0:1788796666.021603:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796666.022942:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936255872 00000100:00100000:0.0:1788796666.022957:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936255872 00000100:00100000:0.0:1788796666.023021:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 177 00000100:00100000:0.0:1788796666.023031:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+59:11490:x1875688936255872:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788796666.023117:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23261 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.023149:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.023164:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788796666.023450:0:10139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788796666.023460:0:10139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 393004713660ns, next at 394004711000ns, rc = 0 00000004:00010000:0.0:1788796666.023547:0:10139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d652d6bc reply state 00000000fe42ced3 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796666.023558:0:10139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788796666.023687:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+61:11490:x1875688936255872:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 656us (2093us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788796666.023695:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 177 00010000:00010000:2.0:1788796666.033570:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.033589:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23261 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.033597:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23261 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.033604:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796666.033608:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23261 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.033639:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23261 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.033656:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:2.0:1788796666.033660:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788796666.033664:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23261 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.033670:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23261 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796666.037332:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796666.037409:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936256000 00000100:00100000:0.0:1788796666.037420:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936256000 00000100:00100000:0.0:1788796666.037482:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 178 00000100:00100000:0.0:1788796666.037493:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+60:11490:x1875688936256000:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788796666.037521:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796666.037545:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe23268 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb8c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.037608:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe23268 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb8c expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.037634:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe23268 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb8c expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.037671:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:0.0:1788796666.037674:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788796666.037679:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5000, rc 0) 00000100:00100000:0.0:1788796666.037738:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+61:11490:x1875688936256000:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 246us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796666.037769:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 178 00000100:00100000:1.0:1788796666.048091:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796666.048182:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936256128 00000100:00100000:0.0:1788796666.048192:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936256128 00000100:00100000:0.0:1788796666.048253:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:0.0:1788796666.048263:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+6:2357:x1875688936256128:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788796666.049116:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936256128:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 359us (540us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788796666.049127:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:2.0:1788796666.065233:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796666.072420:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936256384 00000100:00100000:3.0:1788796666.072435:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936256384 00000100:00100000:3.0:1788796666.072502:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:3.0:1788796666.072512:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+61:11490:x1875688936256384:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788796666.073192:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+62:11490:x1875688936256384:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 679us (7966us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788796666.073199:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 49 00000040:00080000:0.0:1788796666.074279:0:12413:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788796666.074286:0:12413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788796666.074348:0:12413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788796666.074354:0:12413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788796666.085446:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796666.085525:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936256640 00000100:00100000:3.0:1788796666.085537:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936256640 00000100:00100000:3.0:1788796666.085598:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 179 00000100:00100000:3.0:1788796666.085609:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+62:11490:x1875688936256640:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788796666.087142:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+62:11490:x1875688936256640:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 1526us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796666.087155:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 179 00000100:00100000:0.0:1788796666.089705:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796666.089944:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936256768 00000100:00100000:3.0:1788796666.089956:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936256768 00000100:00100000:3.0:1788796666.090085:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 180 00000100:00100000:3.0:1788796666.090095:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+62:11490:x1875688936256768:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788796666.090116:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796666.090138:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2326f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb93 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.090215:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23276 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.090231:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.090242:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796666.090304:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788796666.090323:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.090351:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2326f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb93 expref: 64 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.090368:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb93 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.090376:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:3.0:1788796666.090379:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788796666.090383:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21200, rc 0) 00000100:00100000:3.0:1788796666.090452:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+63:11490:x1875688936256768:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 358us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796666.090460:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 180 00000100:00100000:2.0:1788796666.097483:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796666.097562:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936256896 00000100:00100000:0.0:1788796666.097572:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936256896 00000100:00100000:0.0:1788796666.097644:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:0.0:1788796666.097655:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936256896:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788796666.097673:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796666.097696:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2327d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eb9a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788796666.097735:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9edefa, blocks: 0x1 00010000:00010000:0.0:1788796666.097865:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788796666.097871:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796666.097881:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2327d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb9a expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.097901:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2327d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb9a expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.097915:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d5200, rc 0) 00000100:00100000:0.0:1788796666.097967:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+8:2358:x1875688936256896:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 314us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796666.098133:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:2.0:1788796666.120631:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796666.120704:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936257152 00000100:00100000:0.0:1788796666.120715:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936257152 00000100:00100000:0.0:1788796666.120816:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 181 00000100:00100000:0.0:1788796666.120828:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+63:11490:x1875688936257152:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788796666.120935:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+63:11490:x1875688936257152:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 109us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796666.120942:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 181 00000100:00100000:2.0:1788796666.128570:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796666.128676:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936257280 00000100:00100000:3.0:1788796666.128687:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936257280 00000100:00100000:3.0:1788796666.128772:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:3.0:1788796666.128796:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+8:11490:x1875688936257280:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788796666.128815:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796666.128833:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23284 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eba1 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.128868:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2327d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb9a expref: 9 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.128898:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796666.128902:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796666.128908:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23284 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eba1 expref: 9 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.128943:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2327d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb9a expref: 9 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.128956:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2327d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb9a expref: 9 pid: 6694 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796666.128970:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d89b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875688959323392:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788796666.129050:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27257c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788796666.140581:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d89b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875688959323392:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788796666.140630:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23284 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eba1 expref: 9 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.140649:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20000, rc 0) 00000100:00100000:3.0:1788796666.140710:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+9:11490:x1875688936257280:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 11916us (12148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796666.140718:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:0.0:1788796666.170547:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796666.172740:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936257408 00000100:00100000:1.0:1788796666.172772:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936257408 00010000:00010000:1.0:1788796666.172830:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2327d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb9a expref: 9 pid: 6694 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796666.172878:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:1.0:1788796666.172888:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+9:2357:x1875688936257408:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788796666.172902:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796666.172925:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2327d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb9a expref: 9 pid: 6694 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.172940:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2327d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb9a expref: 9 pid: 6694 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.172964:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2327d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb9a expref: 9 pid: 6694 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.172981:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796666.172985:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796666.173001:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23284 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eba1 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.173011:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23284 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eba1 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.173049:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23284 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eba1 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796666.173065:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1875688959323520:192.168.201.25@tcp:105: 00000100:00100000:1.0:1788796666.173163:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb78d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788796666.184292:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796666.184387:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1875688959323520:192.168.201.25@tcp:105: 00010000:00010000:1.0:1788796666.184413:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796666.184472:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+8:2357:x1875688936257408:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 11583us (13933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796666.184482:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:0.0:1788796666.185501:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936257536 00000100:00100000:0.0:1788796666.185513:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936257536 00002000:00100000:0.0:1788796666.185564:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9bd267304e00 x1875688936257536/t0(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:92/0 lens 504/0 e 0 to 0 dl 1788796677 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788796666.185586:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd267304e00 with x1875688936257536 ext(0->8) 00002000:00010000:0.0:1788796666.185592:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd267304e00 00000100:00100000:0.0:1788796666.185635:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:0.0:1788796666.185646:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad2796a3-2145-47da-88fb-baa43721bec1+8:2358:x1875688936257536:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788796666.186480:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad2796a3-2145-47da-88fb-baa43721bec1+10:2358:x1875688936257536:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 Request processed in 830us (2190us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788796666.186489:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00002000:00100000:0.0:1788796666.186497:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9bd267304e00 x1875688936257536/t4294967314(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:92/0 lens 504/448 e 0 to 0 dl 1788796677 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788796666.186506:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd267304e00 with x1875688936257536 ext(0->8) 00002000:00010000:0.0:1788796666.186511:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd267304e00 00000100:00100000:1.0:1788796666.194208:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796666.194248:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936257664 00000100:00100000:1.0:1788796666.194258:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936257664 00000100:00100000:1.0:1788796666.194305:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 182 00000100:00100000:1.0:1788796666.194315:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+63:11490:x1875688936257664:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1788796666.202991:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788796666.273162:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1788796666.273175:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1788796666.273235:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:3.0:1788796666.273282:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1788796666.273302:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788796666.273312:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd250ba16c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788796666.273317:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd27df2da00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd250ba1f00 00000020:00080000:3.0:1788796666.273321:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd27df2d400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd267646000 00000020:00080000:3.0:1788796666.273485:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1788796666.273834:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+18:11490:x1875688936257664:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 Request processed in 79514us (79629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796666.273857:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 182 00000100:00100000:2.0:1788796666.278072:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959323648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788796666.278153:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796666.278223:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788796666.278230:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27d89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959323776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788796666.278252:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796666.278320:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959323648 00000100:00100000:0.0:1788796666.278329:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959323648 00000100:00100000:0.0:1788796666.278395:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959323776 00000100:00100000:0.0:1788796666.278399:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959323776 00000100:00100000:0.0:1788796666.278421:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788796666.278434:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959323648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788796666.278650:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788796666.278653:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788796666 00002000:00010000:0.0:1788796666.278656:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788796666.278671:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788796666 -> 1788796666 00002000:00010000:0.0:1788796666.278674:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788796666.278725:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875688959323648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 294us (572us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788796666.278732:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788796666.278874:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796666.278956:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788796666.278963:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875688959323776:12345-0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1788796666.280084:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00002000:00080000:0.0:1788796666.280187:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1788796666.280220:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9edef8, atime: 0x6a9edef8, ctime: 0x6a9edef8, blocks: 0x1 00010000:00010000:0.0:1788796666.280229:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe2328b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.280245:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788796666.280250:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796666.280257:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe2328b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.280274:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe2328b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.280285:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe2328b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.280294:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe2328b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.280318:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788796666.280883:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796666.280892:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe2328b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.280901:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4800 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796666.280906:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe2328b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.280917:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe2328b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.280935:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe2328b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.280943:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe2328b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.280963:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796666.280965:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796666.280967:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796666.281221:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796666.281277:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936257792 00000100:00100000:3.0:1788796666.281285:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936257792 00000100:00100000:3.0:1788796666.281321:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:3.0:1788796666.281331:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+10:2357:x1875688936257792:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788796666.283964:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959323776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4993us (5701us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788796666.283977:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1788796666.284055:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd27d89b800/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788796666.284063:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959323776:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788796666.284077:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd27d89b100/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788796666.284081:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27d89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959323648:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1788796666.358739:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1788796666.358809:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1788796666.359035:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936257792:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 Request processed in 77697us (77809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796666.359049:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:3.0:1788796666.361535:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796666.361976:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936258048 00000100:00100000:1.0:1788796666.361987:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936258048 00000100:00100000:1.0:1788796666.362043:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 183 00000100:00100000:1.0:1788796666.362052:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+18:11490:x1875688936258048:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788796666.362119:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796666.362148:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23276 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb93 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.362170:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:1.0:1788796666.362176:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796666.362206:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23292 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.362220:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.362231:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788796666.362478:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce809790 reply state 0000000036bfcef3 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796666.362488:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788796666.362581:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+19:11490:x1875688936258048:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 529us (1055us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788796666.362589:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 183 00000100:00100000:2.0:1788796666.366450:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796666.366517:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936258176 00000100:00100000:0.0:1788796666.366527:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936258176 00000100:00100000:0.0:1788796666.366585:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:0.0:1788796666.366595:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936258176:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788796666.366886:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788796666.366890:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788796666 -> 1788796665 00002000:00010000:0.0:1788796666.366893:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788796664 00002000:00010000:0.0:1788796666.366895:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788796666 -> 1788796665 00002000:00010000:0.0:1788796666.366898:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788796666.366953:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+8:2357:x1875688936258176:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 359us (514us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788796666.366961:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00010000:00010000:3.0:1788796666.370033:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.370053:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23292 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.370062:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23292 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.370070:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796666.370076:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23292 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.370085:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23292 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.370104:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:3.0:1788796666.370107:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796666.370112:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23292 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.370119:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23292 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796666.370542:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796666.370738:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936258432 00000100:00100000:1.0:1788796666.370876:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936258432 00000100:00100000:1.0:1788796666.370937:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 184 00000100:00100000:1.0:1788796666.370947:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+18:11490:x1875688936258432:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788796666.371023:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23299 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.371049:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe2325a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb85 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.371057:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23299 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.371092:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe2325a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb85 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.371106:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe2325a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb85 expref: 18 pid: 5846 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796666.371120:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875688959323904:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788796666.371217:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb78300 going to sleep for 11 seconds 00000100:00100000:1.0:1788796666.375258:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875688959323904:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796666.375290:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23299 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796666.375408:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796666.375443:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936258560 00000100:00100000:3.0:1788796666.375451:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936258560 00010000:00010000:3.0:1788796666.375492:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe2325a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb85 expref: 19 pid: 5846 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796666.375555:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:3.0:1788796666.375565:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+19:2358:x1875688936258560:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796666.375580:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796666.375587:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe2325a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb85 expref: 19 pid: 5846 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.375600:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe2325a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb85 expref: 19 pid: 5846 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.375634:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe2325a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb85 expref: 19 pid: 5846 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.375650:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:3.0:1788796666.375655:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23299 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.375665:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.375674:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23299 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.375716:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796666.375794:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+18:2358:x1875688936258560:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 229us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796666.375802:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 68 00010000:00010000:3.0:1788796666.375894:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.375903:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.375933:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.375940:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23299 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.375947:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23299 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.375954:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796666.375958:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23299 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.375966:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23299 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.375976:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:3.0:1788796666.375980:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788796666.375983:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23299 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.375999:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23299 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796666.376042:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+17:11490:x1875688936258432:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 Request processed in 5096us (5526us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788796666.376051:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 184 00000100:00100000:3.0:1788796666.379872:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796666.379990:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936258688 00000100:00100000:0.0:1788796666.380001:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936258688 00000100:00100000:0.0:1788796666.380056:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:0.0:1788796666.380066:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+8:2358:x1875688936258688:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788796666.380110:0:11435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe232a0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.380146:0:11435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23284 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eba1 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.380154:0:11435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796666.380159:0:11435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788796666.380164:0:11435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe232a0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.380216:0:11435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23284 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eba1 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.380231:0:11435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23284 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eba1 expref: 8 pid: 6692 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796666.380246:0:11435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11435:1875688959324032:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788796666.380328:0:11435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2794a4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788796666.383155:0:11435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11435:1875688959324032:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796666.383188:0:11435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe232a0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796666.384318:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796666.384555:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936258816 00000100:00100000:0.0:1788796666.384564:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936258816 00010000:00010000:0.0:1788796666.384601:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23284 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eba1 expref: 9 pid: 6692 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796666.384690:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:0.0:1788796666.384700:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd245990c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+9:2358:x1875688936258816:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796666.384715:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796666.384738:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23284 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eba1 expref: 9 pid: 6692 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.384794:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23284 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eba1 expref: 9 pid: 6692 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.384821:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23284 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eba1 expref: 9 pid: 6692 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.384841:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788796666.384846:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788796666.384852:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe232a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.384863:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe232a0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.384895:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796666.384943:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd245990c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+8:2358:x1875688936258816:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 245us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796666.384951:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 69 00010000:00010000:3.0:1788796666.385572:0:11435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe232a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.385585:0:11435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe232a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.385615:0:11435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe232a0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.385625:0:11435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe232a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.385635:0:11435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe232a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.385642:0:11435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5200 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796666.385647:0:11435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe232a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.385671:0:11435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe232a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.385686:0:11435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe232a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.385694:0:11435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe232a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796666.385796:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936258688:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 Request processed in 5730us (5931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796666.385806:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:3.0:1788796666.389285:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796666.389378:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936259072 00000100:00100000:1.0:1788796666.389388:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936259072 00000100:00100000:1.0:1788796666.389456:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 185 00000100:00100000:1.0:1788796666.389466:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+17:11490:x1875688936259072:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788796666.389553:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe232a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.389573:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe232a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.389607:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe232a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.390159:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe232ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.390173:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe23268 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb8c expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.390182:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe232ae lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.390217:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe23268 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb8c expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.390231:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe23268 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb8c expref: 18 pid: 5846 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796666.390245:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875688959324160:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788796666.390375:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb78300 going to sleep for 11 seconds 00000100:00100000:1.0:1788796666.394114:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796666.394183:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936259200 00000100:00100000:3.0:1788796666.394194:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936259200 00010000:00010000:3.0:1788796666.394236:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe23268 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb8c expref: 19 pid: 5846 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796666.394281:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:3.0:1788796666.394291:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+19:2357:x1875688936259200:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796666.394306:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796666.394313:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe23268 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb8c expref: 19 pid: 5846 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.394328:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe23268 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb8c expref: 19 pid: 5846 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.394366:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:3.0:1788796666.394382:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe232ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.394392:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe232ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.394400:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe232ae lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.394421:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796666.394608:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+19:2357:x1875688936259200:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 317us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796666.394622:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 70 00010000:00010000:0.0:1788796666.395862:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5000/0xdd273c88cfe23268 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb8c expref: 18 pid: 5846 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796666.395887:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875688959324160:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796666.395914:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe232ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.395924:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe232ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.395931:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe232ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788796666.396253:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788796666.398183:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788796666.398276:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788796666.398462:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5844:1875688959324288:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788796666.398534:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796666.398603:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6900 going to sleep for 11 seconds 00000100:00100000:0.0:1788796666.398712:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959324288 00000100:00100000:0.0:1788796666.398720:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959324288 00000100:00100000:0.0:1788796666.398882:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788796666.398892:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875688959324288:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788796666.399076:0:5844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788796666.399082:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd27d89b100, transno 4294967315 00000100:00100000:0.0:1788796666.399173:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875688959324288:12345-0@lo:1000:mdt00_000.0 Request processed in 76us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796666.399183:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788796666.399226:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5844:1875688959324288:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788796666.399677:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788796666.399797:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5844:1875688959324416:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788796666.399839:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796666.399859:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788796666.399987:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959324416 00000100:00100000:2.0:1788796666.399994:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959324416 00000100:00100000:2.0:1788796666.400036:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788796666.400045:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875688959324416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788796666.400235:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1875688959324416:12345-0@lo:1000:mdt00_000.0 Request processed in 191us (395us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788796666.400243:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788796666.400407:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5844:1875688959324416:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788796666.400438:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe232ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400449:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe232ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400457:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe232ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400463:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796666.400468:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe232ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400476:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe232ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400491:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:1.0:1788796666.400495:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788796666.400500:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe232ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400506:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe232ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400534:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400548:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231e3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400555:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400561:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796666.400564:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400570:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231e3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400578:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd255d57a00) 00010000:00010000:1.0:1788796666.400581:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788796666.400584:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231e3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400591:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe231e3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400611:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe232b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400626:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe231ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb70 expref: 21 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400636:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe232b5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400661:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe231ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb70 expref: 21 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796666.400681:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe231ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb70 expref: 21 pid: 10139 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796666.400694:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875688959324544:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788796666.400804:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788796666.404341:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796666.404404:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936259328 00000100:00100000:0.0:1788796666.404412:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936259328 00010000:00010000:0.0:1788796666.404448:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe231ff lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb70 expref: 22 pid: 10139 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796666.404487:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00100000:0.0:1788796666.404497:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+22:2357:x1875688936259328:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796666.404512:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796666.404528:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe231ff lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb70 expref: 22 pid: 10139 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.404542:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe231ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb70 expref: 22 pid: 10139 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.404564:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd255d57a00) 00010000:00010000:0.0:1788796666.404570:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe232b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.404580:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe232b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.404588:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe232b5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.404608:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796666.404676:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+22:2357:x1875688936259328:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 180us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796666.404684:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 71 00010000:00010000:2.0:1788796666.404853:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe231ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eb70 expref: 21 pid: 10139 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796666.404871:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875688959324544:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796666.404889:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe232b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.404898:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe232b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.404905:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe232b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.404917:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe232b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.404925:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe232b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.404932:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe232b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.404939:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796666.404943:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe232b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.404952:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe232b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.404980:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd255d57a00) 00010000:00010000:2.0:1788796666.404984:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796666.404988:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe232b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.404995:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe232b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.405006:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe232a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.405013:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe232a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.405020:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe232a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.405025:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796666.405028:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe232a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.405034:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe232a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.405041:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd255d57a00) 00010000:00010000:2.0:1788796666.405044:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788796666.405047:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe232a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796666.405053:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe232a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796666.405228:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+20:11490:x1875688936259072:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 15762us (15951us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788796666.405237:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 185 00000020:00080000:2.0:1788796666.405241:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788796666.406083:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788796666.406090:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788796666.406681:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:0.0:1788796666.406690:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788796666.409261:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796666.409343:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936259584 00000100:00100000:3.0:1788796666.409354:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936259584 00000100:00100000:3.0:1788796666.409427:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:3.0:1788796666.409438:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2504d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+20:11490:x1875688936259584:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788796666.410207:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788796666.410316:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788796666.410366:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.410385:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.410399:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.410418:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.410424:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.410430:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796666.410446:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788796666.410559:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2504d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+22:11490:x1875688936259584:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 1121us (1308us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788796666.410567:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 50 00000020:00080000:3.0:1788796666.410572:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788796666.411423:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796666.411433:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.411442:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20600 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796666.411447:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.411466:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.411483:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bd24712b100) 00010000:00010000:0.0:1788796666.411486:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788796666.411491:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232bc lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.411498:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796666.411519:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796666.411521:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796666.411523:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796666.714070:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796666.714096:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959324672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796666.714166:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796666.714297:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959324672 00000100:00100000:0.0:1788796666.714305:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959324672 00000100:00100000:0.0:1788796666.714355:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788796666.714366:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875688959324672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796666.714393:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788796666.714444:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875688959324672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796666.714451:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788796666.714503:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959324672:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788796666.832299:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1788796666.832314:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:3.0:1788796667.226013:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788796667.826415:0:12466:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788796667.826425:0:12466:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788796667.826468:0:12466:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788796667.826473:0:12466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788796667.927957:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796667.928034:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936259840 00000100:00100000:3.0:1788796667.928046:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936259840 00000100:00100000:3.0:1788796667.928118:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 186 00000100:00100000:3.0:1788796667.928128:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+22:11508:x1875688936259840:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788796667.928154:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796667.928174:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe232c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eba8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.928269:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe232ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.928295:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe232ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.928308:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe232ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796667.928319:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788796667.928552:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe232c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eba8 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.928573:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe232ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eba8 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.928581:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:3.0:1788796667.928653:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788796667.928657:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21400, rc 0) 00000100:00100000:3.0:1788796667.928774:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+24:11508:x1875688936259840:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 620us (799us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788796667.928781:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 186 00000100:00080000:2.0:1788796667.928852:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796667.936097:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796667.938624:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936259968 00000100:00100000:2.0:1788796667.938640:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936259968 00000100:00100000:2.0:1788796667.938710:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 187 00000100:00100000:2.0:1788796667.938721:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+24:11508:x1875688936259968:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:2.0:1788796667.939025:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe232d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939044:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe232d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939056:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe232d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939074:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe232df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939082:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe232df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939088:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe232df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939376:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe232e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939450:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe232e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939457:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe232e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788796667.939556:0:10139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe232e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939570:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe232d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939576:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe232d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939583:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe232d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939647:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796667.939651:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe232d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939659:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe232d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939671:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:2.0:1788796667.939674:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796667.939680:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe232d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939693:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe232d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939707:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe232df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939713:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe232df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939718:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe232df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939723:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796667.939726:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe232df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939732:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe232df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939740:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd24d573f00) 00010000:00010000:2.0:1788796667.939742:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796667.939917:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe232df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939924:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe232df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939940:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe232e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939946:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe232e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939960:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe232e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939966:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7c00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796667.939969:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe232e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939975:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe232e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939984:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573d00) 00010000:00010000:2.0:1788796667.939987:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796667.939990:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe232e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796667.939995:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe232e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796667.940131:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+24:11508:x1875688936259968:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 1409us (4040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796667.940141:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 187 00000100:00100000:3.0:1788796667.994020:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796667.994062:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936260224 00000100:00100000:3.0:1788796667.994072:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936260224 00000100:00100000:3.0:1788796667.994132:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 188 00000100:00100000:3.0:1788796667.994143:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+24:11511:x1875688936260224:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788796667.994166:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796667.994189:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe232ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ebaf expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994281:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994296:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994308:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994323:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe232fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994331:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe232fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994339:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe232fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994638:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23302 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994648:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994657:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796667.994668:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788796667.994798:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994807:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994820:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994827:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796667.994832:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994840:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994852:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:3.0:1788796667.994856:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796667.994862:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994869:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe232f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994882:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe232fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994889:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe232fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994895:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe232fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994901:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796667.994904:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe232fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994921:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe232fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994931:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd24712b900) 00010000:00010000:3.0:1788796667.994933:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796667.994937:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe232fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994943:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe232fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.994987:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe232ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebaf expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.995004:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebaf expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.995012:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24712be00) 00010000:00010000:3.0:1788796667.995014:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788796667.995017:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21200, rc 0) 00000100:00100000:3.0:1788796667.995079:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+26:11511:x1875688936260224:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 937us (1069us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788796667.995089:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 188 00000100:00100000:2.0:1788796667.998261:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796667.998321:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936260352 00000100:00100000:3.0:1788796667.998329:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936260352 00000100:00100000:3.0:1788796667.998379:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 189 00000100:00100000:3.0:1788796667.998387:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+26:11511:x1875688936260352:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:3.0:1788796667.998452:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23310 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.998465:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.998474:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.998494:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.998499:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23310 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.998503:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.998507:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796667.998509:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.998514:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.998521:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24712be00) 00010000:00010000:3.0:1788796667.998523:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788796667.998527:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23310 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796667.998530:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23310 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796667.998605:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+26:11511:x1875688936260352:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 217us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796667.998611:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 189 00000100:00100000:2.0:1788796668.000288:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796668.000499:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936260608 00000100:00100000:3.0:1788796668.000510:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936260608 00000100:00100000:3.0:1788796668.000657:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:3.0:1788796668.000669:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+26:11511:x1875688936260608:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788796668.000918:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+27:11511:x1875688936260608:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 251us (634us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788796668.000927:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:3.0:1788796668.016633:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796668.016980:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936260864 00000100:00100000:1.0:1788796668.016992:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936260864 00000100:00100000:1.0:1788796668.017091:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 190 00000100:00100000:1.0:1788796668.017102:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+27:11036:x1875688936260864:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796668.017130:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796668.017153:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23317 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ebb6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.017256:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.017271:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23302 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebaf expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.017280:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.017326:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebaf expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.017339:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23302 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebaf expref: 28 pid: 5846 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796668.017353:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959324800:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788796668.017453:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796668.023915:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796668.024128:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936260992 00000100:00100000:3.0:1788796668.024139:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936260992 00010000:00010000:3.0:1788796668.024182:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23302 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebaf expref: 29 pid: 5846 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796668.024220:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 72 00000100:00100000:3.0:1788796668.024231:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261296d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+29:2358:x1875688936260992:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796668.024246:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796668.024253:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23302 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebaf expref: 29 pid: 5846 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.024268:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23302 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebaf expref: 29 pid: 5846 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.024310:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24712be00) 00010000:00010000:3.0:1788796668.024316:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.024327:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.024335:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.024354:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796668.024416:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261296d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+29:2358:x1875688936260992:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 187us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796668.024423:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 72 00010000:00010000:1.0:1788796668.024708:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23302 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebaf expref: 28 pid: 5846 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796668.024725:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959324800:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796668.024775:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.024785:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.024791:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796668.024808:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788796668.024963:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23317 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebb6 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.024980:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebb6 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.025000:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24712be00) 00010000:00010000:1.0:1788796668.025003:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788796668.025005:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334e00, rc 0) 00000100:00100000:1.0:1788796668.025041:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+28:11036:x1875688936260864:12345-192.168.201.25@tcp:101:bash.0 Request processed in 7941us (8420us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788796668.025048:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 190 00000100:00100000:2.0:1788796668.030578:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796668.033646:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936261248 00000100:00100000:3.0:1788796668.033660:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936261248 00000100:00100000:3.0:1788796668.033730:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 191 00000100:00100000:3.0:1788796668.033764:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+28:11036:x1875688936261248:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:2.0:1788796668.034103:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2332c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.034121:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2332c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.034152:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2332c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788796668.034211:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788796668.034235:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc33d380 reply state 00000000de627361 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2332c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796668.034245:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788796668.034293:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788796668.034406:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+32:11036:x1875688936261248:12345-192.168.201.25@tcp:36:bash.0 Request processed in 665us (3837us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788796668.034413:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 191 00000020:00080000:2.0:1788796668.034417:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788796668.036588:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796668.036678:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936261376 00000100:00100000:1.0:1788796668.036688:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936261376 00000100:00100000:1.0:1788796668.036738:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 192 00000100:00100000:1.0:1788796668.036791:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+32:11036:x1875688936261376:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796668.036814:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796668.036834:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23333 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ebbd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.036895:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23333 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebbd expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.036910:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23333 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebbd expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.036929:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24712be00) 00010000:00010000:1.0:1788796668.036932:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788796668.036937:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335c00, rc 0) 00000100:00100000:1.0:1788796668.036986:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+33:11036:x1875688936261376:12345-192.168.201.25@tcp:101:bash.0 Request processed in 199us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796668.037009:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 192 00010000:00010000:2.0:1788796668.037028:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2332c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.037037:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2332c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.037043:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2332c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.037049:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796668.037053:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2332c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.037061:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2332c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.037072:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24712be00) 00010000:00010000:2.0:1788796668.037081:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796668.037085:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2332c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.037091:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2332c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796668.038260:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796668.038332:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936261504 00000100:00100000:1.0:1788796668.038340:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936261504 00000100:00100000:1.0:1788796668.038401:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:1.0:1788796668.038410:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+7:11036:x1875688936261504:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796668.038423:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796668.038442:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c73df3/0xdd273c88cfe2333a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ebc4 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788796668.038467:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9edef9, atime: 0x6a9edef8, ctime: 0x6a9edef9, blocks: 0xb 00000100:00080000:2.0:1788796668.038486:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788796668.038486:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1788796668.038491:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796668.038499:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c73df3/0xdd273c88cfe2333a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebc4 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.038517:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9c73df3/0xdd273c88cfe2333a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebc4 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.038527:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335400, rc 0) 00000100:00100000:1.0:1788796668.038579:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+8:11036:x1875688936261504:12345-192.168.201.25@tcp:101:bash.0 Request processed in 170us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796668.038586:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:1.0:1788796668.044944:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796668.045101:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936261632 00000100:00100000:2.0:1788796668.045111:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936261632 00002000:00010000:2.0:1788796668.045155:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788796668.045159:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd2671b9c00 with x1875688936261632 ext(0->18446744073709551615) 00002000:00010000:2.0:1788796668.045170:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd2671b9c00. 00000100:00100000:2.0:1788796668.045204:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1788796668.045214:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad2796a3-2145-47da-88fb-baa43721bec1+8:2358:x1875688936261632:12345-192.168.201.25@tcp:10:bash.0 00002000:00010000:2.0:1788796668.045553:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788796668.045557:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788796665 -> 1788796668 00002000:00010000:2.0:1788796668.045560:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788796664 -> 1788796664 00002000:00010000:2.0:1788796668.045562:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788796665 -> 1788796668 00002000:00010000:2.0:1788796668.045564:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788796668.045673:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad2796a3-2145-47da-88fb-baa43721bec1+9:2358:x1875688936261632:12345-192.168.201.25@tcp:10:bash.0 Request processed in 460us (740us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788796668.045681:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00002000:00010000:2.0:1788796668.045684:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788796668.045687:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd2671b9c00 with x1875688936261632 ext(0->18446744073709551615) 00002000:00010000:2.0:1788796668.045691:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd2671b9c00. 00000100:00100000:2.0:1788796668.155165:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796668.155269:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936261760 00000100:00100000:3.0:1788796668.155280:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936261760 00000100:00100000:3.0:1788796668.155338:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 193 00000100:00100000:3.0:1788796668.155349:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+32:11525:x1875688936261760:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:3.0:1788796668.155428:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23341 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155465:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155478:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155495:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe23348 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155503:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe23348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155511:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe23348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155792:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fc00/0xdd273c88cfe2334f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155802:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fc00/0xdd273c88cfe2334f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155811:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fc00/0xdd273c88cfe2334f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788796668.155848:0:10139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fc00/0xdd273c88cfe2334f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155859:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155866:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23341 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155905:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23341 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155913:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152f600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796668.155918:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23341 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155925:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23341 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155938:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:3.0:1788796668.155941:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796668.155947:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23341 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155954:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23341 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155968:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe23348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155975:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe23348 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155982:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe23348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.155987:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152fe00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796668.155990:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe23348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.156008:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe23348 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.156017:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd24712b900) 00010000:00010000:3.0:1788796668.156020:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796668.156023:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe23348 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.156029:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe23348 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.156044:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fc00/0xdd273c88cfe2334f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.156051:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fc00/0xdd273c88cfe2334f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.156057:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fc00/0xdd273c88cfe2334f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.156061:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152fc00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796668.156064:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fc00/0xdd273c88cfe2334f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.156070:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fc00/0xdd273c88cfe2334f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.156077:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24712be00) 00010000:00010000:3.0:1788796668.156080:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796668.156083:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fc00/0xdd273c88cfe2334f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.156098:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fc00/0xdd273c88cfe2334f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796668.156182:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+32:11525:x1875688936261760:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 833us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796668.156190:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 193 00000100:00100000:3.0:1788796668.209523:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796668.209689:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936262016 00000100:00100000:1.0:1788796668.209700:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936262016 00000100:00100000:1.0:1788796668.209827:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 194 00000100:00100000:1.0:1788796668.209838:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+32:11528:x1875688936262016:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796668.209858:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796668.209878:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23356 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ebcb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.209966:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2335d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.209980:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2335d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.209993:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2335d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210008:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23364 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210016:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210023:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210292:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2336b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210302:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2336b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210309:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2336b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796668.210330:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788796668.210422:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2335d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210431:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2335d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210438:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2335d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210445:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796668.210449:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2335d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210457:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2335d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210468:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796668.210471:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796668.210476:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2335d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210483:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe2335d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210494:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210500:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23364 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210516:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210522:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796668.210525:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210531:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23364 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210538:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd255d57000) 00010000:00010000:1.0:1788796668.210541:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796668.210543:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23364 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210549:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23364 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210603:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23356 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebcb expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210619:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2336b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebcb expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.210627:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24712be00) 00010000:00010000:1.0:1788796668.210629:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788796668.210632:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334400, rc 0) 00000100:00100000:1.0:1788796668.210697:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+34:11528:x1875688936262016:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 860us (1183us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788796668.210713:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 194 00000100:00100000:1.0:1788796668.214086:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796668.214225:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936262144 00000100:00100000:2.0:1788796668.214248:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936262144 00000100:00100000:2.0:1788796668.214307:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 195 00000100:00100000:2.0:1788796668.214317:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+34:11528:x1875688936262144:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:2.0:1788796668.214380:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23379 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.214398:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebb6 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.214408:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23379 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.214441:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebb6 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.214455:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebb6 expref: 34 pid: 5846 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796668.214470:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261296680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875688959324928:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796668.214559:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a533000 going to sleep for 11 seconds 00000100:00100000:1.0:1788796668.217144:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261296680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875688959324928:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796668.217176:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23379 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796668.217260:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796668.217337:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936262400 00000100:00100000:2.0:1788796668.217345:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936262400 00000100:00100000:2.0:1788796668.217442:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:2.0:1788796668.217452:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+35:5597:x1875688936262400:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788796668.218172:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+36:5597:x1875688936262400:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 719us (1144us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788796668.218181:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:3.0:1788796668.220817:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796668.221021:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936262528 00000100:00100000:0.0:1788796668.221032:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936262528 00010000:00010000:0.0:1788796668.221070:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebb6 expref: 36 pid: 5846 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796668.221137:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00100000:0.0:1788796668.221149:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26793b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+36:2358:x1875688936262528:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796668.221178:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796668.221187:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebb6 expref: 36 pid: 5846 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796668.221200:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebb6 expref: 36 pid: 5846 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796668.221222:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2331e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebb6 expref: 36 pid: 5846 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796668.221248:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24712be00) 00010000:00010000:0.0:1788796668.221253:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23379 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796668.221263:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796668.221271:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23379 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796668.221299:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796668.221332:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.221342:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796668.221357:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26793b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+35:2358:x1875688936262528:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 210us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796668.221365:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 73 00010000:00010000:1.0:1788796668.222880:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.222894:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23379 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.222901:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23379 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.222908:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796668.222912:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23379 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.222921:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23379 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.222995:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24712be00) 00010000:00010000:1.0:1788796668.222999:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796668.223017:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23379 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.223085:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23379 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796668.223216:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+34:11528:x1875688936262144:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 8896us (9135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796668.223225:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 195 00000100:00100000:0.0:1788796668.226675:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796668.226905:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936262784 00000100:00100000:3.0:1788796668.226915:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936262784 00000100:00100000:3.0:1788796668.227127:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:3.0:1788796668.227138:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+34:11528:x1875688936262784:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788796668.227378:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+35:11528:x1875688936262784:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 242us (714us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788796668.227387:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 53 00010000:00010000:0.0:1788796668.250849:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796668.344579:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796668.344860:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936263040 00000100:00100000:1.0:1788796668.344870:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936263040 00000100:00100000:1.0:1788796668.344928:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 196 00000100:00100000:1.0:1788796668.344938:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+35:11539:x1875688936263040:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:1.0:1788796668.344971:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796668.344995:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23380 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ebd2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345324:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23387 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345339:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23387 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345350:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23387 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345365:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2338e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345382:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2338e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345407:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2338e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345696:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23395 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345705:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345712:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796668.345722:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788796668.345883:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23387 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345892:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23387 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345899:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23387 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345905:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796668.345910:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23387 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345918:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23387 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345931:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796668.345934:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796668.345945:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23387 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345960:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23387 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345974:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2338e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345980:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2338e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345985:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2338e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345989:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796668.345991:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2338e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.345996:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2338e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.346004:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd255d57000) 00010000:00010000:1.0:1788796668.346006:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796668.346009:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2338e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.346015:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe2338e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.346714:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23380 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebd2 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.347422:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebd2 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.347432:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24712be00) 00010000:00010000:1.0:1788796668.347435:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796668.347438:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335e00, rc 0) 00000100:00100000:1.0:1788796668.347526:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+37:11539:x1875688936263040:12345-192.168.201.25@tcp:101:cat.0 Request processed in 2588us (2957us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788796668.347535:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 196 00000100:00100000:0.0:1788796668.354961:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796668.355717:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936263296 00000100:00100000:3.0:1788796668.355731:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936263296 00000100:00100000:3.0:1788796668.355846:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:3.0:1788796668.355858:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+37:11539:x1875688936263296:12345-192.168.201.25@tcp:35:cat.0 00000100:00100000:3.0:1788796668.356162:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+38:11539:x1875688936263296:12345-192.168.201.25@tcp:35:cat.0 Request processed in 305us (1211us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788796668.356169:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:3.0:1788796668.387216:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796668.387379:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936263552 00000100:00100000:2.0:1788796668.387396:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936263552 00000100:00100000:2.0:1788796668.387466:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 197 00000100:00100000:2.0:1788796668.387476:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26793b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+38:11540:x1875688936263552:12345-192.168.201.25@tcp:36:rm.0 00010000:00010000:2.0:1788796668.387536:0:10139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788796668.387564:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe23395 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebd2 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.387598:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2336b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebcb expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.387611:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe23333 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebbd expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.387620:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24712be00) 00010000:00010000:2.0:1788796668.387633:0:10139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788796668.387653:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe233a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.387666:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe233a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.387689:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe233a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.387704:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe233aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.387712:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe233aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.387729:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe233aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.387996:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388005:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388013:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788796668.388516:0:10139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788796668.388526:0:10139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395369779185ns, next at 396369776705ns, rc = 0 00010000:00010000:2.0:1788796668.388579:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe233b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388589:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe233b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388597:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe233b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388604:0:10139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe233b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388609:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe233b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388616:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe233b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388651:0:10139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788796668.388671:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388678:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388685:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388691:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796668.388695:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388702:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388711:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573f00) 00010000:00010000:2.0:1788796668.388714:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788796668.388718:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388724:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388789:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe233a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388796:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe233a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388812:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe233a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388817:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796668.388819:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe233a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388826:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe233a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388834:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:2.0:1788796668.388836:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796668.388839:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe233a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.388845:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe233a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788796668.388855:0:10139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004cba06fe reply state 00000000b4897329 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe233aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796668.388863:0:10139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788796668.388943:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26793b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+37:11540:x1875688936263552:12345-192.168.201.25@tcp:36:rm.0 Request processed in 1465us (1733us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788796668.388951:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 197 00010000:00010000:3.0:1788796668.389727:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796668.389770:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe233b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.389779:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6c00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796668.389783:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe233b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.389791:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe233b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.389803:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bd24d573f00) 00010000:00010000:3.0:1788796668.389805:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788796668.389809:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe233b8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.389814:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe233b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.389829:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796668.389831:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796668.389833:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796668.393701:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe233aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.393720:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe233aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.393729:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe233aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.393764:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796668.393770:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe233aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.393780:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe233aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.393797:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd24d573d00) 00010000:00010000:1.0:1788796668.393801:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796668.393806:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe233aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.393829:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe233aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788796668.442079:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788796668.442091:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788796668.442327:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788796668.442336:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788796668.447659:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796668.448022:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936263808 00000100:00100000:1.0:1788796668.448034:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936263808 00000100:00100000:1.0:1788796668.448142:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 198 00000100:00100000:1.0:1788796668.448152:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+36:11546:x1875688936263808:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796668.448179:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796668.448201:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe233bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ebd9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.448332:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe233c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.448347:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe233c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.448358:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe233c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.448372:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe233cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.448379:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe233cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.448403:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe233cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788796668.448993:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788796668.449152:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe233d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.449164:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe233d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.449172:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe233d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.449207:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe233c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.449215:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe233c6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.449222:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe233c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.449229:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796668.449234:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe233c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.449241:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe233c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.449252:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:1.0:1788796668.449255:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796668.449266:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe233c6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.449272:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe233c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788796668.449285:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000445809fb reply state 0000000039caa4db transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe233cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796668.449293:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788796668.449322:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe233bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebd9 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.449335:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe233d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebd9 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.449342:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd255d57900) 00010000:00010000:1.0:1788796668.449344:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796668.449347:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335c00, rc 0) 00000100:00100000:1.0:1788796668.449408:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+39:11546:x1875688936263808:12345-192.168.201.25@tcp:101:bash.0 Request processed in 1256us (1758us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788796668.449415:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 198 00010000:00010000:2.0:1788796668.453469:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe233cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.453558:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe233cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.453584:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe233cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.453591:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796668.453596:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe233cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.453604:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe233cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.453621:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd255d57000) 00010000:00010000:2.0:1788796668.453624:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796668.453629:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe233cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.453636:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe233cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796668.454462:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796668.454519:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936263936 00000100:00100000:0.0:1788796668.454530:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936263936 00000100:00100000:0.0:1788796668.454604:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:0.0:1788796668.454618:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+5:2356:x1875688936263936:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1788796668.454636:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796668.454657:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe233e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ebe0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788796668.454684:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796668.454709:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=395s v=(0 0) 00010000:00010000:0.0:1788796668.454716:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796668.454725:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe233e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe0 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796668.454780:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe233e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe0 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796668.454792:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d4800, rc 0) 00000100:00100000:0.0:1788796668.454851:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2356:x1875688936263936:12345-192.168.201.25@tcp:101:bash.0 Request processed in 237us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796668.454858:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00080000:2.0:1788796668.455284:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788796668.457168:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796668.457385:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936264064 00000100:00100000:1.0:1788796668.457394:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936264064 00000100:00100000:1.0:1788796668.457466:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:1.0:1788796668.457474:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+6:11546:x1875688936264064:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796668.457490:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796668.457505:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ebe7 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.457547:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe233e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe0 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.457553:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796668.457556:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796668.457560:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.457594:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe233e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe0 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.457603:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe233e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe0 expref: 7 pid: 6692 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796668.457613:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1875688959325056:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788796668.457687:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788796668.460049:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1875688959325056:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796668.460080:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796668.460163:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335e00, rc 0) 00000100:00100000:0.0:1788796668.460226:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+7:11546:x1875688936264064:12345-192.168.201.25@tcp:101:bash.0 Request processed in 2751us (3065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796668.460234:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:0.0:1788796668.460910:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796668.460983:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936264192 00000100:00100000:3.0:1788796668.460991:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936264192 00010000:00010000:3.0:1788796668.461022:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe233e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe0 expref: 7 pid: 6692 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796668.461058:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:3.0:1788796668.461067:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e378700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936264192:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796668.461091:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796668.461185:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe233e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe0 expref: 7 pid: 6692 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.461199:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe233e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe0 expref: 7 pid: 6692 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.461224:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005349edb/0xdd273c88cfe233e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe0 expref: 7 pid: 6692 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.461239:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796668.461244:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796668.461252:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.461262:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.461297:0:8457:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796668.461312:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267939f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8457:1875688959325184:192.168.201.25@tcp:105: 00000100:00100000:3.0:1788796668.461458:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d9ae480 going to sleep for 11 seconds 00000100:00100000:3.0:1788796668.466613:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796668.467259:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267939f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8457:1875688959325184:192.168.201.25@tcp:105: 00010000:00010000:1.0:1788796668.467285:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796668.467336:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e378700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+6:2357:x1875688936264192:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 6270us (6426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796668.467347:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:2.0:1788796668.467467:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936264448 00000100:00100000:2.0:1788796668.467476:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936264448 00000100:00100000:2.0:1788796668.467525:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:2.0:1788796668.467533:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26793b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+38:11546:x1875688936264448:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:2.0:1788796668.467906:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26793b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+39:11546:x1875688936264448:12345-192.168.201.25@tcp:35:bash.0 Request processed in 372us (1303us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788796668.467913:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:1.0:1788796668.605393:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796668.605496:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936264576 00000100:00100000:2.0:1788796668.605505:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936264576 00000100:00100000:2.0:1788796668.605578:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 199 00000100:00100000:2.0:1788796668.605598:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+39:11562:x1875688936264576:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788796668.605622:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796668.605645:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe233f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ebee expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.605706:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.605719:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.605730:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796668.605800:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788796668.605803:0:10139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788796668.605821:0:10139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.605846:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe233f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebee expref: 41 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.605866:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebee expref: 40 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.605875:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:2.0:1788796668.605877:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788796668.605881:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7a00, rc 0) 00000100:00100000:2.0:1788796668.606116:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+40:11562:x1875688936264576:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 519us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796668.606129:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 199 00000100:00100000:3.0:1788796668.609442:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796668.609607:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936264832 00000100:00100000:1.0:1788796668.609617:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936264832 00000100:00100000:1.0:1788796668.609681:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 200 00000100:00100000:1.0:1788796668.609693:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+40:11562:x1875688936264832:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796668.609713:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796668.609850:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe233fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ebf5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.610019:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.610033:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.610045:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796668.610056:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788796668.610182:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe233fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebf5 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.610202:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebf5 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.610210:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd255d57900) 00010000:00010000:1.0:1788796668.610213:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796668.610217:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334600, rc 0) 00000100:00100000:1.0:1788796668.610416:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+42:11562:x1875688936264832:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 725us (982us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788796668.610424:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 200 00000100:00100000:0.0:1788796668.615062:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796668.615136:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796668.615207:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936265216 00000100:00100000:2.0:1788796668.615218:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936265216 00000100:00100000:2.0:1788796668.615281:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:2.0:1788796668.615291:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e379c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+42:2355:x1875688936265216:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796668.615308:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796668.615333:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe23405 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebf5 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.615350:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd255d57900) 00010000:00010000:2.0:1788796668.615356:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796668.615430:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e379c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+41:2355:x1875688936265216:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 141us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796668.615437:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:1.0:1788796668.616917:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936265088 00000100:00100000:1.0:1788796668.617001:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936265088 00000100:00100000:1.0:1788796668.617081:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 201 00000100:00100000:1.0:1788796668.617091:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+41:11562:x1875688936265088:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796668.617114:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796668.617132:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23413 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ebfc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.617229:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2341a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.617243:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2341a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.617255:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2341a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796668.617267:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788796668.617408:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335000/0xdd273c88cfe23413 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebfc expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.617426:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2341a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebfc expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.617434:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd255d57900) 00010000:00010000:1.0:1788796668.617437:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788796668.617441:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334400, rc 0) 00000100:00100000:1.0:1788796668.617497:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+43:11562:x1875688936265088:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 408us (2445us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788796668.617504:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 201 00000100:00100000:0.0:1788796668.621381:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796668.621533:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936265344 00000100:00100000:3.0:1788796668.621544:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936265344 00000100:00100000:3.0:1788796668.621609:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:3.0:1788796668.621619:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+6:2357:x1875688936265344:12345-192.168.201.25@tcp:1:lfs.0 00010000:00010000:3.0:1788796668.621662:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bd978a7/0xdd273c88cfe23428 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.621683:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.621692:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796668.621697:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788796668.621702:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bd978a7/0xdd273c88cfe23428 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.621781:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.621797:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 6 pid: 6691 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796668.621812:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26793ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1875688959325312:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788796668.621894:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d9ae840 going to sleep for 11 seconds 00000100:00100000:3.0:1788796668.624328:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796668.624362:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936265472 00000100:00100000:3.0:1788796668.624384:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936265472 00002000:00100000:3.0:1788796668.624433:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9bd267939880 x1875688936265472/t0(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:94/0 lens 504/0 e 0 to 0 dl 1788796679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788796668.624456:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd267939880 with x1875688936265472 ext(0->8) 00010000:00010000:3.0:1788796668.624466:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 7 pid: 6691 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.624481:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 7 pid: 6691 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788796668.624488:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bd267939880 00000100:00100000:3.0:1788796668.624515:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:3.0:1788796668.624524:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936265472:12345-192.168.201.25@tcp:4:lfs.0 00000100:00100000:3.0:1788796668.625057:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad2796a3-2145-47da-88fb-baa43721bec1+9:2358:x1875688936265472:12345-192.168.201.25@tcp:4:lfs.0 Request processed in 532us (735us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788796668.625065:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00002000:00100000:3.0:1788796668.625074:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9bd267939880 x1875688936265472/t4294967308(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:94/0 lens 504/448 e 0 to 0 dl 1788796679 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788796668.625082:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd267939880 with x1875688936265472 ext(0->8) 00010000:00010000:3.0:1788796668.625088:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 9 pid: 6691 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.625099:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 9 pid: 6691 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788796668.625106:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bd267939880 00000100:00100000:3.0:1788796668.625153:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26793ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1875688959325312:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788796668.625181:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004bd978a7/0xdd273c88cfe23428 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796668.629202:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796668.629287:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936265600 00000100:00100000:2.0:1788796668.629297:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936265600 00010000:00010000:2.0:1788796668.629338:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 9 pid: 6691 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796668.629414:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:2.0:1788796668.629425:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd245993c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+9:2355:x1875688936265600:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796668.629442:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788796668.629461:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788796668.629464:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788796669 00002000:00010000:2.0:1788796668.629467:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788796669 00002000:00010000:2.0:1788796668.629469:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788796669 00010000:00010000:2.0:1788796668.629490:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 9 pid: 6691 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.629505:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 9 pid: 6691 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.629529:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb0171b1/0xdd273c88cfe233e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebe7 expref: 9 pid: 6691 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.629544:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788796668.629548:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788796668.629554:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004bd978a7/0xdd273c88cfe23428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.629563:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bd978a7/0xdd273c88cfe23428 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.629603:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796668.629702:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd245993c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+8:2355:x1875688936265600:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 277us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796668.629709:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 75 00010000:00010000:3.0:1788796668.629875:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004bd978a7/0xdd273c88cfe23428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.629886:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bd978a7/0xdd273c88cfe23428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.629910:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bd978a7/0xdd273c88cfe23428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.629918:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bd978a7/0xdd273c88cfe23428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.629936:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bd978a7/0xdd273c88cfe23428 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.629944:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152fc00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796668.629948:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bd978a7/0xdd273c88cfe23428 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.629955:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bd978a7/0xdd273c88cfe23428 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.629965:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bd978a7/0xdd273c88cfe23428 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.629979:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bd978a7/0xdd273c88cfe23428 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796668.630025:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936265344:12345-192.168.201.25@tcp:1:lfs.0 Request processed in 8407us (8665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796668.630033:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:3.0:1788796668.632659:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796668.632842:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936265856 00000100:00100000:2.0:1788796668.632852:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936265856 00000100:00100000:2.0:1788796668.632912:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:2.0:1788796668.632923:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2504d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+43:11562:x1875688936265856:12345-192.168.201.25@tcp:35:lfs.0 00000004:00010000:2.0:1788796668.633001:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2341a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebfc expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788796668.633269:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1788796668.633313:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788796668.634105:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788796668.634168:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2342f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.634184:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe233d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebd9 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.634193:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2342f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.634229:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe233d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebd9 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.634243:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe233d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebd9 expref: 47 pid: 5846 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796668.634257:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261296d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875688959325440:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796668.634347:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a533840 going to sleep for 11 seconds 00000100:00100000:0.0:1788796668.637570:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796668.637663:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936265984 00000100:00100000:1.0:1788796668.637675:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936265984 00010000:00010000:1.0:1788796668.637716:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe233d4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebd9 expref: 48 pid: 5846 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796668.637789:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 76 00000100:00100000:1.0:1788796668.637800:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e378380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+48:2358:x1875688936265984:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788796668.637821:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796668.637828:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe233d4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebd9 expref: 48 pid: 5846 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.637842:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe233d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebd9 expref: 48 pid: 5846 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.637863:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd255d57900) 00010000:00010000:1.0:1788796668.637869:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2342f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.637878:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2342f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.637885:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2342f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.637905:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796668.637967:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e378380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+48:2358:x1875688936265984:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 168us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796668.637975:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 76 00010000:00010000:2.0:1788796668.638378:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335c00/0xdd273c88cfe233d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebd9 expref: 47 pid: 5846 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796668.638395:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261296d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875688959325440:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796668.638417:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2342f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.638444:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2342f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.638450:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2342f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788796668.638588:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788796668.638816:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788796668.638927:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261296d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959325568:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788796668.638979:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796668.639069:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a533480 going to sleep for 11 seconds 00000100:00100000:3.0:1788796668.639695:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959325568 00000100:00100000:3.0:1788796668.639702:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959325568 00000100:00100000:3.0:1788796668.639799:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788796668.639809:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1875688959325568:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1788796668.639966:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788796668.640090:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1875688959325568:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 282us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796668.640098:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788796668.640695:0:5848:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788796668.640716:0:5848:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1788796668.640906:0:5848:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd27d89b800, transno 4294967307 00000100:00100000:1.0:1788796668.641013:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261296d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959325568:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788796668.641541:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788796668.641641:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959325696:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788796668.641695:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796668.641730:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27db93b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788796668.641922:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959325696 00000100:00100000:1.0:1788796668.641996:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959325696 00000100:00100000:1.0:1788796668.642045:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788796668.642053:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875688959325696:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788796668.642222:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1875688959325696:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 169us (526us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788796668.642230:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788796668.642339:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875688959325696:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788796668.642388:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788796668.642424:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2342f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796668.642434:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2342f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796668.642441:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2342f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796668.642447:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796668.642460:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2342f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796668.642467:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2342f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796668.642482:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd255d57900) 00010000:00010000:0.0:1788796668.642485:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788796668.642490:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2342f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796668.642496:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2342f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788796668.642723:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788796668.642966:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1788796668.642977:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 395624230534ns, next at 396624228036ns, rc = 0 00000001:00080000:0.0:1788796668.642984:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788796668.643016:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd255d57900) 00010000:00010000:0.0:1788796668.643019:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788796668.643027:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe2341a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebfc expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796668.643115:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2504d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+50:11562:x1875688936265856:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 10193us (10468us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788796668.643123:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00000020:00080000:0.0:1788796668.643127:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788796668.645905:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796668.646044:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936266112 00000100:00100000:3.0:1788796668.646054:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936266112 00000100:00100000:3.0:1788796668.646118:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 202 00000100:00100000:3.0:1788796668.646129:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+50:11562:x1875688936266112:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788796668.646154:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796668.646179:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fc00/0xdd273c88cfe23436 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec03 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.646243:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fc00/0xdd273c88cfe23436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec03 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.646275:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fc00/0xdd273c88cfe23436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec03 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.646299:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:3.0:1788796668.646302:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788796668.646306:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd24152fc00, rc 0) 00000100:00100000:3.0:1788796668.646658:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+51:11562:x1875688936266112:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 241us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796668.646667:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 202 00000100:00100000:1.0:1788796668.649517:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796668.649893:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936266368 00000100:00100000:3.0:1788796668.649905:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936266368 00000100:00100000:3.0:1788796668.650058:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:3.0:1788796668.650069:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+51:11562:x1875688936266368:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788796668.650310:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+52:11562:x1875688936266368:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 242us (800us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788796668.650317:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:0.0:1788796668.764009:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796668.764333:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936266496 00000100:00100000:2.0:1788796668.764344:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936266496 00000100:00100000:2.0:1788796668.764413:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 203 00000100:00100000:2.0:1788796668.764423:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+52:11571:x1875688936266496:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:2.0:1788796668.764502:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2343d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.764518:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2343d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.764531:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2343d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.764548:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23444 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.764555:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.764587:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.764671:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2344b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.764680:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2344b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.764687:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2344b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788796668.764728:0:10139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2344b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.764802:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2343d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765052:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2343d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765059:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2343d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765065:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796668.765068:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2343d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765075:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2343d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765087:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:2.0:1788796668.765096:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796668.765101:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2343d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765108:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2343d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765123:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765128:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23444 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765134:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765139:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796668.765141:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765147:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23444 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765155:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd24d573000) 00010000:00010000:2.0:1788796668.765157:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796668.765160:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23444 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765166:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23444 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765181:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2344b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765195:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2344b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765200:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2344b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765206:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796668.765209:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2344b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765215:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2344b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765222:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:2.0:1788796668.765224:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796668.765239:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2344b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.765244:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe2344b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796668.765350:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+52:11571:x1875688936266496:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 927us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796668.765358:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 203 00000100:00100000:1.0:1788796668.836955:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796668.837155:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936266752 00000100:00100000:3.0:1788796668.837168:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936266752 00000100:00100000:3.0:1788796668.837232:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 204 00000100:00100000:3.0:1788796668.837242:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+52:11575:x1875688936266752:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788796668.837267:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796668.837292:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe23452 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec0a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837368:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23459 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837397:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23459 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837410:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23459 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837426:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152e600/0xdd273c88cfe23460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837432:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152e600/0xdd273c88cfe23460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837439:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152e600/0xdd273c88cfe23460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837558:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23467 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837566:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837585:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796668.837595:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788796668.837689:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23459 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837697:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23459 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837703:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23459 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837717:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152f600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796668.837722:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23459 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837743:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23459 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837793:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:3.0:1788796668.837796:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796668.837802:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23459 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837809:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152f600/0xdd273c88cfe23459 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837825:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152e600/0xdd273c88cfe23460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837830:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152e600/0xdd273c88cfe23460 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837836:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152e600/0xdd273c88cfe23460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837841:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152e600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796668.837844:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152e600/0xdd273c88cfe23460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837850:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152e600/0xdd273c88cfe23460 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837868:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd24712bf00) 00010000:00010000:3.0:1788796668.837870:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796668.837873:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152e600/0xdd273c88cfe23460 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837878:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152e600/0xdd273c88cfe23460 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837918:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fe00/0xdd273c88cfe23452 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec0a expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837946:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23467 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec0a expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.837954:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:3.0:1788796668.837956:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788796668.837958:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21200, rc 0) 00000100:00100000:3.0:1788796668.838033:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+54:11575:x1875688936266752:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 793us (1090us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788796668.838041:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 204 00000100:00100000:0.0:1788796668.841915:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796668.842044:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936266880 00000100:00100000:2.0:1788796668.842056:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936266880 00000100:00100000:2.0:1788796668.842118:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 205 00000100:00100000:2.0:1788796668.842129:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+54:11575:x1875688936266880:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:2.0:1788796668.842200:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23475 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.842223:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.842235:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.842262:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.842268:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23475 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.842275:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.842280:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796668.842284:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.842291:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23475 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.842302:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:2.0:1788796668.842305:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788796668.842309:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23475 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.842315:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23475 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796668.842396:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+54:11575:x1875688936266880:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 268us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796668.842408:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 205 00000100:00100000:0.0:1788796668.844640:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796668.844785:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936267136 00000100:00100000:2.0:1788796668.844796:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936267136 00000100:00100000:2.0:1788796668.844847:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:2.0:1788796668.844858:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+54:11575:x1875688936267136:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788796668.845102:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+55:11575:x1875688936267136:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 245us (470us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788796668.845110:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:0.0:1788796668.967078:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796668.968386:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936267392 00000100:00100000:3.0:1788796668.968400:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936267392 00000100:00100000:3.0:1788796668.968475:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 206 00000100:00100000:3.0:1788796668.968485:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+55:11585:x1875688936267392:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788796668.968509:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796668.968513:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788796668.968542:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe233f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebee expref: 55 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.968583:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:3.0:1788796668.968589:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788796668.968604:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe2347c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec11 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.968809:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe23483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.968824:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe23483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.968834:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe23483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796668.968846:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788796668.968979:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe2347c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec11 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.968997:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe23483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec11 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.969005:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:3.0:1788796668.969009:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788796668.969011:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20200, rc 0) 00000100:00100000:3.0:1788796668.969080:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+56:11585:x1875688936267392:12345-192.168.201.25@tcp:101:bash.0 Request processed in 596us (2010us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788796668.969087:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 206 00000100:00100000:0.0:1788796668.979031:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796668.979118:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936267648 00000100:00100000:2.0:1788796668.979129:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936267648 00000100:00100000:2.0:1788796668.979186:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 207 00000100:00100000:2.0:1788796668.979196:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+56:11585:x1875688936267648:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:2.0:1788796668.979252:0:10139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788796668.979278:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe23483 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec11 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.979301:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23467 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec0a expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.979310:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:2.0:1788796668.979315:0:10139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788796668.979514:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23491 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.979527:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796668.979558:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788796668.979620:0:10139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788796668.979645:0:10139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9c6cf8d reply state 0000000062529d5c transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796668.979654:0:10139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788796668.979791:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+57:11585:x1875688936267648:12345-192.168.201.25@tcp:36:bash.0 Request processed in 595us (768us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788796668.979797:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 207 00000020:00080000:2.0:1788796668.979802:0:10139:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788796668.981328:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.981342:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23491 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.981349:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.981355:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796668.981360:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.981368:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23491 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.981392:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:1.0:1788796668.981405:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796668.981411:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23491 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796668.981417:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6800/0xdd273c88cfe23491 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796668.992350:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796668.992545:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936267776 00000100:00100000:3.0:1788796668.992556:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936267776 00000100:00100000:3.0:1788796668.992619:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 208 00000100:00100000:3.0:1788796668.992629:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+56:11585:x1875688936267776:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788796668.992651:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796668.992669:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23498 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec18 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.992792:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2349f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.992806:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2349f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.992818:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2349f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796668.992844:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788796668.992847:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788796668.992863:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2349f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.992887:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23498 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec18 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.992906:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2349f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec18 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796668.992915:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:3.0:1788796668.992918:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788796668.992945:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20000, rc 0) 00000100:00100000:3.0:1788796668.992991:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+57:11585:x1875688936267776:12345-192.168.201.25@tcp:101:bash.0 Request processed in 365us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796668.992998:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 208 00000100:00100000:0.0:1788796669.019686:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.019837:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936268032 00000100:00100000:2.0:1788796669.019848:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936268032 00000100:00100000:2.0:1788796669.019936:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:2.0:1788796669.019948:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+57:11585:x1875688936268032:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:2.0:1788796669.020189:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+58:11585:x1875688936268032:12345-192.168.201.25@tcp:35:bash.0 Request processed in 243us (512us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788796669.020197:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00080000:3.0:1788796669.020531:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796669.079342:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.079449:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936268160 00000100:00100000:2.0:1788796669.079460:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936268160 00000100:00100000:2.0:1788796669.079524:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 209 00000100:00100000:2.0:1788796669.079535:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+58:11591:x1875688936268160:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788796669.079561:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796669.079592:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe234a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec1f expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.079686:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe234ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.079701:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe234ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.079715:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe234ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796669.079807:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788796669.079811:0:10139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788796669.079828:0:10139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe234ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.079852:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe234a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec1f expref: 60 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.079873:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe234ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec1f expref: 59 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.079882:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:2.0:1788796669.079885:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788796669.079889:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7400, rc 0) 00000100:00100000:2.0:1788796669.079960:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+59:11591:x1875688936268160:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 427us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796669.079968:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 209 00000100:00100000:0.0:1788796669.083817:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796669.084009:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936268288 00000100:00100000:3.0:1788796669.084020:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936268288 00000100:00100000:3.0:1788796669.084117:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 210 00000100:00100000:3.0:1788796669.084128:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+59:11591:x1875688936268288:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788796669.084148:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796669.084169:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe234b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084246:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084261:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084274:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084289:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084296:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084303:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084407:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe234c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084415:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe234c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084423:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe234c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796669.084457:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788796669.084461:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788796669.084478:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe234c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084489:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe234c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084497:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084503:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084509:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084515:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796669.084518:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084525:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084541:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:3.0:1788796669.084543:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796669.084549:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084554:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084581:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084588:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084593:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084598:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796669.084600:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084606:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084613:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd24712bf00) 00010000:00010000:3.0:1788796669.084615:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796669.084618:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084624:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084664:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe234b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec26 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084678:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe234c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec26 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.084684:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:3.0:1788796669.084686:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788796669.084688:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20200, rc 0) 00000100:00100000:3.0:1788796669.084793:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+60:11591:x1875688936268288:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 666us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796669.084800:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 210 00000100:00100000:0.0:1788796669.094222:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796669.094283:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.094393:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936268544 00000100:00100000:2.0:1788796669.094405:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936268544 00000100:00100000:2.0:1788796669.094492:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 211 00000100:00100000:2.0:1788796669.094505:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+60:11591:x1875688936268544:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788796669.094526:0:10139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796669.094549:0:10139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe234d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec2d expref: -99 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.094665:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.094681:0:10139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2349f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec18 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.094689:0:10139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe234c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec26 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.094698:0:10139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.094778:0:10139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe234c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec26 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.094794:0:10139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe234c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec26 expref: 61 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796669.094808:0:10139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261295c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10139:1875688959325824:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796669.094909:0:10139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2349f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec18 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.094942:0:10139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2349f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec18 expref: 61 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796669.094952:0:10139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261294a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10139:1875688959325952:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796669.094979:0:10139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a533840 going to sleep for 11 seconds 00000100:00100000:1.0:1788796669.096709:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936268672 00000100:00100000:1.0:1788796669.096720:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936268672 00010000:00010000:1.0:1788796669.096800:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe234c9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec26 expref: 62 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796669.096845:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:1.0:1788796669.096854:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e379c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+62:2358:x1875688936268672:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788796669.096866:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796669.096872:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe234c9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec26 expref: 62 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.096884:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe234c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec26 expref: 62 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.096904:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:1.0:1788796669.096909:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.096927:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.096934:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796669.096989:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e379c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+62:2358:x1875688936268672:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 136us (2706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796669.097008:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 77 00010000:00010000:2.0:1788796669.099966:0:10139:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.25@tcp) returned -22 from blocking AST (req@0000000065af6095 x1875688959325824) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe234c9 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec26 expref: 61 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.099990:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20200/0xdd273c88cfe234c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec26 expref: 61 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796669.100009:0:10139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261295c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10139:1875688959325824:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796669.100023:0:10139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261294a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10139:1875688959325952:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796669.100048:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:2.0:1788796669.100052:0:10139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.100060:0:10139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.100069:0:10139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796669.100342:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796669.100954:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936268800 00000100:00100000:1.0:1788796669.100964:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936268800 00010000:00010000:1.0:1788796669.100998:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2349f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec18 expref: 61 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796669.101036:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:1.0:1788796669.101045:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+61:2357:x1875688936268800:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788796669.101059:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796669.101065:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2349f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec18 expref: 61 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.101075:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2349f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec18 expref: 61 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.101095:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe2349f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec18 expref: 61 pid: 5845 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.101107:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:1.0:1788796669.101111:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.101120:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.101127:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.101180:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796669.101245:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+60:2357:x1875688936268800:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 200us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796669.101252:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 78 00010000:00010000:2.0:1788796669.101934:0:10139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.101954:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796669.101974:0:10139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788796669.102124:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe234d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec2d expref: 61 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.102143:0:10139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec2d expref: 60 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.102151:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:2.0:1788796669.102154:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788796669.102157:0:10139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6e00, rc 0) 00000100:00100000:2.0:1788796669.102580:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+60:11591:x1875688936268544:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 8069us (8371us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788796669.102588:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 211 00000100:00100000:0.0:1788796669.116873:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796669.117011:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936269056 00000100:00100000:1.0:1788796669.117021:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936269056 00000100:00100000:1.0:1788796669.117088:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:1.0:1788796669.117099:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+60:11591:x1875688936269056:12345-192.168.201.25@tcp:103:lfs.0 00010000:00010000:1.0:1788796669.117116:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796669.117140:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd24152fc00/0xdd273c88cfe23436 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec03 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.117163:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:1.0:1788796669.117168:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796669.117236:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+59:11591:x1875688936269056:12345-192.168.201.25@tcp:103:lfs.0 Request processed in 138us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796669.117244:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:3.0:1788796669.125612:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796669.125790:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936269184 00000100:00100000:1.0:1788796669.125800:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936269184 00000100:00100000:1.0:1788796669.125865:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 212 00000100:00100000:1.0:1788796669.125877:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26793ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+59:11591:x1875688936269184:12345-192.168.201.25@tcp:58:lfs.0 00010000:00010000:1.0:1788796669.126004:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe234e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.126026:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe234e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.126061:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe234e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788796669.126451:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788796669.126545:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26793ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+59:11591:x1875688936269184:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 669us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796669.126553:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 212 00000100:00100000:0.0:1788796669.128629:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796669.128788:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936269312 00000100:00100000:3.0:1788796669.128799:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936269312 00000100:00100000:3.0:1788796669.128860:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 213 00000100:00100000:3.0:1788796669.128870:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+59:11591:x1875688936269312:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788796669.128890:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796669.128911:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec34 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.128967:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe234e5 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.128978:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234ec lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec34 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.129015:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe234e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.129031:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234ec lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec34 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.129045:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:3.0:1788796669.129048:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788796669.129053:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234ec lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec34 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.129060:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21200, rc 0) 00000100:00100000:3.0:1788796669.129116:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+60:11591:x1875688936269312:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 248us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796669.129124:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 213 00010000:00010000:0.0:1788796669.273944:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788796669.466009:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788796669.466020:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788796669.466078:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788796669.466085:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788796669.466223:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1875688959326080:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788796669.466578:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788796669.478122:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.478360:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936269440 00000100:00100000:2.0:1788796669.478371:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936269440 00000100:00100000:2.0:1788796669.478432:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 214 00000100:00100000:2.0:1788796669.478443:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+61:11592:x1875688936269440:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788796669.478476:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788796669.478578:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+61:11592:x1875688936269440:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 138us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796669.478586:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 214 00000100:00100000:1.0:1788796669.482524:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1875688959326080:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788796669.492135:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796669.492306:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936269568 00000100:00100000:3.0:1788796669.492318:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936269568 00000100:00100000:3.0:1788796669.492373:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 215 00000100:00100000:3.0:1788796669.492384:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25030fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+60:11592:x1875688936269568:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788796669.492460:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe234f3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.492480:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe234f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.492494:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe234f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.492528:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234fa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.492536:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.492543:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.492681:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe23501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.492692:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe23501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.492699:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe23501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796669.492860:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788796669.492865:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788796669.493119:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe23501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493134:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe234f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493141:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe234f3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493148:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe234f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493164:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796669.493168:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe234f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493176:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe234f3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493188:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:3.0:1788796669.493191:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796669.493196:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe234f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493202:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe234f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493217:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493223:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234fa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493228:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493233:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796669.493236:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493243:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234fa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493262:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9bd24712bf00) 00010000:00010000:3.0:1788796669.493265:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796669.493268:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234fa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493275:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe234fa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493291:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe23501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493298:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe23501 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493303:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe23501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493308:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796669.493311:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe23501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493317:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe23501 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493325:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:3.0:1788796669.493327:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796669.493330:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe23501 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.493335:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20000/0xdd273c88cfe23501 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796669.493474:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25030fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+60:11592:x1875688936269568:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 Request processed in 1090us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796669.493483:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 215 00000100:00100000:0.0:1788796669.497071:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.497161:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936269824 00000100:00100000:2.0:1788796669.497172:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936269824 00000100:00100000:2.0:1788796669.497246:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 216 00000100:00100000:2.0:1788796669.497257:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+60:11592:x1875688936269824:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788796669.497279:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796669.497302:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23508 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec3b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.497417:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe2350f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.497432:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe2350f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.497443:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe2350f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796669.497455:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788796669.497572:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe2350f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.497580:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe2350f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.497587:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe2350f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.497592:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796669.497597:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe2350f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.497604:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe2350f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.497628:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:2.0:1788796669.497631:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788796669.497638:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe2350f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.497644:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe2350f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.497687:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23508 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec3b expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.497698:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:2.0:1788796669.497700:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788796669.497704:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23508 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec3b expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.497714:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6400, rc 0) 00000100:00100000:2.0:1788796669.497845:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+61:11592:x1875688936269824:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 589us (783us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788796669.497852:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 216 00000100:00100000:0.0:1788796669.514851:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.515020:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936269952 00000100:00100000:2.0:1788796669.515030:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936269952 00000100:00100000:2.0:1788796669.515086:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 217 00000100:00100000:2.0:1788796669.515096:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+61:11592:x1875688936269952:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788796669.515152:0:10139:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788796669.515251:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+61:11592:x1875688936269952:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 155us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796669.515269:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 217 00000100:00100000:3.0:1788796669.520499:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.521031:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936270208 00000100:00100000:2.0:1788796669.521045:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936270208 00000100:00100000:2.0:1788796669.521125:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 218 00000100:00100000:2.0:1788796669.521135:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26793aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+61:11592:x1875688936270208:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788796669.521157:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796669.521161:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788796669.521187:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe234ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec1f expref: 61 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.521208:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:2.0:1788796669.521213:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788796669.521227:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe2351d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec42 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788796669.521652:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788796669.522086:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.522100:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.522111:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.522161:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe2351d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec42 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.522190:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec42 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.522198:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd24d573000) 00010000:00010000:2.0:1788796669.522201:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788796669.522203:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7e00, rc 0) 00000100:00100000:2.0:1788796669.522276:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26793aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+62:11592:x1875688936270208:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1142us (1788us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788796669.522284:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 218 00000100:00100000:0.0:1788796669.533289:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.533389:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936270464 00000100:00100000:2.0:1788796669.533399:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936270464 00000100:00100000:2.0:1788796669.533455:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 219 00000100:00100000:2.0:1788796669.533465:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+62:11592:x1875688936270464:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788796669.533544:0:10139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796669.533582:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec42 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533602:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd24d573000) 00010000:00010000:2.0:1788796669.533614:0:10139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788796669.533635:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23532 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533648:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533657:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533678:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23539 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x957cdffa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533684:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23539 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x957cdffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533690:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23539 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x957cdffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533829:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533837:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23532 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533844:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23532 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533850:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796669.533854:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23532 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533861:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23532 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533869:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:2.0:1788796669.533871:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796669.533875:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23532 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533880:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23532 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533896:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23539 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x957cdffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533902:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23539 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x957cdffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533907:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23539 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x957cdffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533922:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796669.533924:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23539 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x957cdffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533930:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23539 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x957cdffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533936:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x957cdffa (ffff9bd24d573400) 00010000:00010000:2.0:1788796669.533938:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796669.533941:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23539 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x957cdffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.533946:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe23539 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x957cdffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796669.534015:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+61:11592:x1875688936270464:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 551us (737us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788796669.534023:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 219 00000100:00100000:1.0:1788796669.537118:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.537197:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936270592 00000100:00100000:2.0:1788796669.537207:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936270592 00000100:00100000:2.0:1788796669.537265:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 220 00000100:00100000:2.0:1788796669.537286:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+61:11592:x1875688936270592:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788796669.537305:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796669.537325:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe23540 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec49 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.537356:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23547 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.537368:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.537391:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.537478:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe23540 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec49 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.537499:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec49 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.537507:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd24d573d00) 00010000:00010000:2.0:1788796669.537509:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788796669.537514:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7600, rc 0) 00000100:00100000:2.0:1788796669.537583:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+62:11592:x1875688936270592:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 298us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796669.537589:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 220 00000100:00100000:3.0:1788796669.544123:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.544301:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936270848 00000100:00100000:2.0:1788796669.544312:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936270848 00000100:00100000:2.0:1788796669.544369:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 221 00000100:00100000:2.0:1788796669.544393:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26793a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+62:11592:x1875688936270848:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788796669.544472:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2354e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.544489:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2354e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.544502:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2354e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788796669.544789:0:10139:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1788796669.544800:0:10139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396526053526ns, next at 397526050489ns, rc = 0 00000004:00010000:2.0:1788796669.544883:0:10139:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064843248 reply state 000000002d75ec7a transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2354e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796669.544893:0:10139:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788796669.544994:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26793a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+64:11592:x1875688936270848:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 603us (881us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788796669.545001:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 221 00010000:00010000:2.0:1788796669.548067:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2354e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.548087:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2354e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.548096:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2354e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.548102:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796669.548106:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2354e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.548132:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2354e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.548149:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd24d573d00) 00010000:00010000:2.0:1788796669.548152:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788796669.548157:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2354e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.548164:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2354e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796669.550053:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.550407:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936270976 00000100:00100000:2.0:1788796669.550419:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936270976 00000100:00100000:2.0:1788796669.550481:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 222 00000100:00100000:2.0:1788796669.550492:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26793a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+63:11592:x1875688936270976:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788796669.550520:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796669.550542:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23555 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec50 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.550618:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec50 expref: 64 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.550635:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec50 expref: 64 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.550656:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd24d573d00) 00010000:00010000:2.0:1788796669.550659:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788796669.550663:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6400, rc 0) 00000100:00100000:2.0:1788796669.550772:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26793a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+64:11592:x1875688936270976:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 282us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796669.550779:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 222 00000100:00100000:1.0:1788796669.555299:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796669.555433:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936271104 00000100:00100000:3.0:1788796669.555445:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936271104 00000100:00100000:3.0:1788796669.555503:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:3.0:1788796669.555513:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+9:2357:x1875688936271104:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788796669.555840:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+10:2357:x1875688936271104:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 328us (550us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788796669.555847:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:1.0:1788796669.558843:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.558931:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936271360 00000100:00100000:2.0:1788796669.558940:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936271360 00000100:00100000:2.0:1788796669.558991:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:2.0:1788796669.559000:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+64:11592:x1875688936271360:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788796669.559205:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+65:11592:x1875688936271360:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 206us (371us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788796669.559218:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:1.0:1788796669.573663:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796669.574011:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936271616 00000100:00100000:3.0:1788796669.574022:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936271616 00000100:00100000:3.0:1788796669.574080:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 223 00000100:00100000:3.0:1788796669.574091:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+65:11592:x1875688936271616:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788796669.574349:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+65:11592:x1875688936271616:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 258us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796669.574357:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 223 00000100:00100000:0.0:1788796669.593304:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.593402:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936271744 00000100:00100000:2.0:1788796669.593413:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936271744 00000100:00100000:2.0:1788796669.593474:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 224 00000100:00100000:2.0:1788796669.593485:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+65:11592:x1875688936271744:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788796669.593507:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796669.593528:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2355c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec57 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.593616:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe23563 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.593631:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe23563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.593644:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe23563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796669.593681:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788796669.594133:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe23563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.594164:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7400/0xdd273c88cfe2355c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec57 expref: 67 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.594182:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe23563 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec57 expref: 66 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.594190:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd24d573d00) 00010000:00010000:2.0:1788796669.594193:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788796669.594196:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6c00, rc 0) 00000100:00100000:2.0:1788796669.594252:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+66:11592:x1875688936271744:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 769us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796669.594260:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 224 00000100:00100000:3.0:1788796669.597225:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796669.597321:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936271872 00000100:00100000:1.0:1788796669.597332:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936271872 00000100:00100000:1.0:1788796669.597597:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:1.0:1788796669.597607:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d50d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+10:2357:x1875688936271872:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788796669.597626:0:11435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796669.597647:0:11435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e80e627e/0xdd273c88cfe2356a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec5e expref: -99 pid: 11435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788796669.597691:0:11435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9edefe, blocks: 0x1 00010000:00010000:1.0:1788796669.597710:0:11435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=396s v=(0 0) 00010000:00010000:1.0:1788796669.597724:0:11435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796669.597934:0:11435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e80e627e/0xdd273c88cfe2356a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec5e expref: 11 pid: 11435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.597955:0:11435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e80e627e/0xdd273c88cfe2356a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec5e expref: 11 pid: 11435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.597969:0:11435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335000, rc 0) 00000100:00100000:1.0:1788796669.598031:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d50d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+11:2357:x1875688936271872:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 426us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796669.598038:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:1.0:1788796669.610684:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796669.612933:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936272128 00000100:00100000:3.0:1788796669.612954:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936272128 00000100:00100000:3.0:1788796669.613046:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 225 00000100:00100000:3.0:1788796669.613058:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+66:11592:x1875688936272128:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788796669.613211:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+66:11592:x1875688936272128:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 155us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796669.613219:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 225 00000100:00100000:2.0:1788796669.617673:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796669.617861:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936272256 00000100:00100000:3.0:1788796669.617872:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936272256 00000100:00100000:3.0:1788796669.617933:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:3.0:1788796669.617943:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+11:11592:x1875688936272256:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788796669.617961:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796669.617977:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe23571 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec65 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.618010:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e80e627e/0xdd273c88cfe2356a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec5e expref: 12 pid: 11435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.618020:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796669.618024:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796669.618030:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe23571 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec65 expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.618061:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e80e627e/0xdd273c88cfe2356a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec5e expref: 12 pid: 11435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.618075:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e80e627e/0xdd273c88cfe2356a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec5e expref: 12 pid: 11435 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796669.618089:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267938e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1875688959326208:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788796669.623534:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d9ae840 going to sleep for 11 seconds 00000100:00100000:2.0:1788796669.625228:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267938e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1875688959326208:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796669.625279:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe23571 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec65 expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.625315:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20200, rc 0) 00000100:00100000:2.0:1788796669.625392:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+12:11592:x1875688936272256:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 7450us (7729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796669.625401:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:1.0:1788796669.632801:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.632897:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936272384 00000100:00100000:2.0:1788796669.632916:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936272384 00010000:00010000:2.0:1788796669.632957:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e80e627e/0xdd273c88cfe2356a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec5e expref: 12 pid: 11435 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796669.633016:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:2.0:1788796669.633024:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261327800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+12:2357:x1875688936272384:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796669.633040:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796669.633063:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e80e627e/0xdd273c88cfe2356a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec5e expref: 12 pid: 11435 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.633076:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e80e627e/0xdd273c88cfe2356a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec5e expref: 12 pid: 11435 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.633099:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e80e627e/0xdd273c88cfe2356a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec5e expref: 12 pid: 11435 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.633117:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796669.633121:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796669.633129:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe23571 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec65 expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.633138:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe23571 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec65 expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.633172:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe23571 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec65 expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796669.633186:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261295c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1875688959326336:192.168.201.25@tcp:105: 00000100:00100000:2.0:1788796669.633555:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a533600 going to sleep for 11 seconds 00000100:00100000:2.0:1788796669.636312:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261295c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1875688959326336:192.168.201.25@tcp:105: 00010000:00010000:2.0:1788796669.636352:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796669.636415:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261327800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+11:2357:x1875688936272384:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 3390us (3624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796669.636426:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:1.0:1788796669.642169:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796669.642255:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936272512 00000100:00100000:0.0:1788796669.642265:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936272512 00002000:00100000:0.0:1788796669.642326:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9bd261324380 x1875688936272512/t0(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:95/0 lens 504/0 e 0 to 0 dl 1788796680 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788796669.642339:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd261324380 with x1875688936272512 ext(0->12) 00002000:00010000:0.0:1788796669.642354:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd261324380 00000100:00100000:0.0:1788796669.642388:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:0.0:1788796669.642397:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad2796a3-2145-47da-88fb-baa43721bec1+11:2355:x1875688936272512:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788796669.642921:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad2796a3-2145-47da-88fb-baa43721bec1+13:2355:x1875688936272512:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 Request processed in 512us (749us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788796669.642929:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00002000:00100000:0.0:1788796669.642938:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9bd261324380 x1875688936272512/t4294967320(0) o4->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:95/0 lens 504/448 e 0 to 0 dl 1788796680 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788796669.642946:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd261324380 with x1875688936272512 ext(0->12) 00002000:00010000:0.0:1788796669.642950:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd261324380 00000100:00100000:3.0:1788796669.646135:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796669.646275:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936272640 00000100:00100000:0.0:1788796669.646286:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936272640 00000100:00100000:0.0:1788796669.646383:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 226 00000100:00100000:0.0:1788796669.646394:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+66:11592:x1875688936272640:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788796669.694993:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967494 is committed 00000004:00080000:3.0:1788796669.695006:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788796669.695031:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd27db93840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788796669.695036:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd247c65700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd27db93d80 00000020:00080000:3.0:1788796669.695039:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd247c65b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd2611fd800 00000020:00080000:1.0:1788796669.695076:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788796669.695088:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd27d7a6c00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788796669.695091:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd2470df900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd27d7a6900 00000020:00080000:3.0:1788796669.695095:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd2470dfe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd267646800 00000001:00080000:3.0:1788796669.695111:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:1.0:1788796669.695111:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 4 00000004:00080000:3.0:1788796669.695117:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:3.0:1788796669.695153:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788796669.695186:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1788796669.695318:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959326464:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1788796669.695364:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788796669.695521:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+20:11592:x1875688936272640:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 Request processed in 49125us (49391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796669.695532:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 226 00000100:00100000:2.0:1788796669.697057:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26793bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959326592:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788796669.697118:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796669.697169:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788796669.697175:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959326720:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788796669.697198:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796669.697288:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959326592 00000100:00100000:0.0:1788796669.697307:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959326592 00000100:00100000:0.0:1788796669.697369:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959326720 00000100:00100000:0.0:1788796669.697373:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959326720 00000100:00100000:0.0:1788796669.697396:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788796669.697404:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875688959326592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788796669.697567:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788796669.697571:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788796670 00002000:00010000:0.0:1788796669.697574:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788796669.697576:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788796670 -> 1788796670 00002000:00010000:0.0:1788796669.697579:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788796669.697638:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959326592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 234us (520us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788796669.697643:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788796669.697656:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788796669.697660:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875688959326720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788796669.697672:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1788796669.697693:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9edefd, atime: 0x6a9edefd, ctime: 0x6a9edefd, blocks: 0x1 00010000:00010000:0.0:1788796669.697701:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe23578 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.697727:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1788796669.697732:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796669.697739:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe23578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.697774:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe23578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.697784:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe23578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.697791:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe23578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.697809:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788796669.698279:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959326720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 617us (1079us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788796669.698295:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1788796669.698340:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd261295c00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788796669.698347:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959326720:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788796669.698359:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd26793bb80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788796669.698362:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26793bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959326592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788796669.698414:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796669.698498:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:3.0:1788796669.698502:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796669.698510:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe23578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.698519:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4600 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796669.698524:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe23578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.698535:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe23578 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788796669.698544:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788796669.698566:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe23578 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.698574:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0ebb665/0xdd273c88cfe23578 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.698596:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796669.698598:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796669.698599:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796669.699321:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959326464 00000100:00100000:3.0:1788796669.699329:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959326464 00000100:00100000:3.0:1788796669.699368:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936272768 00000100:00100000:3.0:1788796669.699372:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936272768 00000100:00100000:3.0:1788796669.699402:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788796669.699411:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:3.0:1788796669.699412:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1875688959326464:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788796669.699419:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+13:2358:x1875688936272768:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 00002000:00080000:3.0:1788796669.699433:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1788796669.699447:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe2357f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.699463:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9c73df3/0xdd273c88cfe2333a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebc4 expref: 13 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.699471:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788796669.699475:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788796669.699479:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe2357f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.699525:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9c73df3/0xdd273c88cfe2333a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebc4 expref: 13 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.699907:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9c73df3/0xdd273c88cfe2333a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebc4 expref: 13 pid: 6691 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796669.699922:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267938e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875688959326848:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788796669.700002:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d9ae780 going to sleep for 11 seconds 00000100:00100000:1.0:1788796669.702225:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796669.702388:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267938e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875688959326848:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788796669.702415:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe2357f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796669.705693:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936272896 00000100:00100000:0.0:1788796669.705709:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936272896 00010000:00010000:0.0:1788796669.705876:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c73df3/0xdd273c88cfe2333a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebc4 expref: 14 pid: 6691 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796669.705931:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:0.0:1788796669.705942:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261327100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+14:2358:x1875688936272896:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796669.705959:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796669.705965:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9c73df3/0xdd273c88cfe2333a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebc4 expref: 14 pid: 6691 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.705981:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9c73df3/0xdd273c88cfe2333a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebc4 expref: 14 pid: 6691 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.706006:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c73df3/0xdd273c88cfe2333a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ebc4 expref: 14 pid: 6691 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.706036:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788796669.706040:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788796669.706046:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe2357f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.706053:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe2357f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.706080:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788796669.706102:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe2357f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.706111:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe2357f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.706120:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe2357f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.706127:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe2357f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796669.706136:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261327100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad2796a3-2145-47da-88fb-baa43721bec1+13:2358:x1875688936272896:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 196us (3920us total) trans 0 rc 0/0 00010000:00010000:2.0:1788796669.706141:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788796669.706143:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 80 00010000:00010000:0.0:1788796669.706164:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796669.706169:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe2357f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.706177:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20000 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796669.706181:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe2357f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.706190:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe2357f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.706200:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe2357f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.706228:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe2357f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.706246:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796669.706248:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796669.706249:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796669.707031:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3305:x1875688959326464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7619us (8613us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788796669.707078:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1788796669.707418:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd267938700/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788796669.707426:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959326464:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788796669.735039:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:1.0:1788796669.735060:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1788796669.735364:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936272768:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 Request processed in 35937us (36859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796669.735377:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:1.0:1788796669.742223:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796669.742300:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936273152 00000100:00100000:3.0:1788796669.742311:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936273152 00000100:00100000:3.0:1788796669.742427:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 227 00000100:00100000:3.0:1788796669.742439:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+20:11592:x1875688936273152:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788796669.742497:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796669.742522:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe23563 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec57 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.742543:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd24d573d00) 00010000:00010000:3.0:1788796669.742549:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788796669.742579:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23586 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.742611:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.742622:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788796669.742889:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d177b7b reply state 0000000055313fc6 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796669.742896:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788796669.742988:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad2796a3-2145-47da-88fb-baa43721bec1+21:11592:x1875688936273152:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 550us (773us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788796669.742995:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 227 00010000:00010000:1.0:1788796669.745927:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.745961:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23586 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.745970:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.745977:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796669.745983:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.745993:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23586 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.746009:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd24d573d00) 00010000:00010000:1.0:1788796669.746012:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796669.746017:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23586 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.746024:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23586 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796669.747441:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796669.747521:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936273280 00000100:00100000:0.0:1788796669.747531:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936273280 00000100:00100000:0.0:1788796669.747986:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:0.0:1788796669.747996:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936273280:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788796669.748230:0:11435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788796669.748235:0:11435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788796670 -> 1788796669 00002000:00010000:0.0:1788796669.748237:0:11435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788796669 00002000:00010000:0.0:1788796669.748239:0:11435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788796670 -> 1788796669 00002000:00010000:0.0:1788796669.748242:0:11435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788796669.748308:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+8:2357:x1875688936273280:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 312us (872us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788796669.748316:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:0.0:1788796669.753323:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.753455:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936273536 00000100:00100000:2.0:1788796669.753465:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936273536 00000100:00100000:2.0:1788796669.753523:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 228 00000100:00100000:2.0:1788796669.753534:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+20:11592:x1875688936273536:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788796669.753622:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe2358d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.753640:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23547 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec49 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.753650:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe2358d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.753684:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec49 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.753699:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23547 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec49 expref: 20 pid: 5846 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796669.753726:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959326976:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796669.753839:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb30b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788796669.759549:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875688959326976:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796669.759586:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe2358d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796669.765929:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.766003:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936273664 00000100:00100000:2.0:1788796669.766033:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936273664 00010000:00010000:2.0:1788796669.766080:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23547 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec49 expref: 21 pid: 5846 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796669.766129:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:2.0:1788796669.766139:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd245992c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+21:2358:x1875688936273664:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796669.766156:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796669.766163:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23547 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec49 expref: 21 pid: 5846 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.766177:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec49 expref: 21 pid: 5846 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.766202:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7600/0xdd273c88cfe23547 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec49 expref: 21 pid: 5846 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.766337:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd24d573d00) 00010000:00010000:2.0:1788796669.766344:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe2358d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.766354:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe2358d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.766362:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe2358d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.766396:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796669.766457:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd245992c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad2796a3-2145-47da-88fb-baa43721bec1+20:2358:x1875688936273664:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 319us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796669.766477:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 81 00010000:00010000:1.0:1788796669.766580:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe2358d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.766589:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe2358d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.766620:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe2358d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.766637:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe2358d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.766643:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe2358d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.766649:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796669.766653:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe2358d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.766660:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe2358d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.766669:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd24d573d00) 00010000:00010000:1.0:1788796669.766671:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788796669.766675:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe2358d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.766681:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe2358d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796669.766797:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+19:11592:x1875688936273536:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 Request processed in 13264us (13483us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788796669.766805:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 228 00000100:00100000:0.0:1788796669.775161:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.775304:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936273792 00000100:00100000:2.0:1788796669.775316:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936273792 00000100:00100000:2.0:1788796669.775378:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:2.0:1788796669.775388:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+8:2357:x1875688936273792:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788796669.775433:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d34fd9ad/0xdd273c88cfe23594 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.775454:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe23571 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec65 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.775463:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796669.775467:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788796669.775471:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d34fd9ad/0xdd273c88cfe23594 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.775503:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe23571 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec65 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.775518:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe23571 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec65 expref: 8 pid: 6694 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796669.775546:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875688959327104:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796669.775628:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb300c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796669.777339:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875688959327104:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796669.777381:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d34fd9ad/0xdd273c88cfe23594 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796669.780265:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.780333:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936273920 00000100:00100000:2.0:1788796669.780343:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936273920 00010000:00010000:2.0:1788796669.780384:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe23571 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec65 expref: 9 pid: 6694 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796669.780429:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:2.0:1788796669.780439:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+9:2358:x1875688936273920:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796669.780454:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796669.780477:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe23571 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec65 expref: 9 pid: 6694 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.780491:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe23571 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec65 expref: 9 pid: 6694 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.780530:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006891bb5d/0xdd273c88cfe23571 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec65 expref: 9 pid: 6694 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.780549:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788796669.780554:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788796669.780559:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d34fd9ad/0xdd273c88cfe23594 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.780569:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d34fd9ad/0xdd273c88cfe23594 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.780617:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796669.780672:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+8:2358:x1875688936273920:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 234us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796669.780679:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 82 00010000:00010000:3.0:1788796669.781925:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d34fd9ad/0xdd273c88cfe23594 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.781942:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d34fd9ad/0xdd273c88cfe23594 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.781972:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d34fd9ad/0xdd273c88cfe23594 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.781978:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d34fd9ad/0xdd273c88cfe23594 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.781983:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d34fd9ad/0xdd273c88cfe23594 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.782000:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7600 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796669.782003:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d34fd9ad/0xdd273c88cfe23594 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.782010:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d34fd9ad/0xdd273c88cfe23594 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.782021:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d34fd9ad/0xdd273c88cfe23594 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.782026:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d34fd9ad/0xdd273c88cfe23594 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796669.782099:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936273792:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 Request processed in 6711us (6946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796669.782107:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:0.0:1788796669.784842:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.785026:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936274176 00000100:00100000:2.0:1788796669.785037:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936274176 00000100:00100000:2.0:1788796669.785171:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 229 00000100:00100000:2.0:1788796669.785181:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+19:11592:x1875688936274176:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788796669.785272:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2359b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.785291:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2359b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.785302:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2359b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.785512:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe235a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796669.785949:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2612f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959327360:0@lo:400:kworker.0 00000100:00100000:0.0:1788796669.786002:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796669.786047:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2612f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959327232:0@lo:400:kworker.0 00000100:00100000:1.0:1788796669.786087:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796669.786146:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959327232 00000100:00100000:1.0:1788796669.786152:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959327232 00000100:00100000:1.0:1788796669.786186:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788796669.786220:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3304:x1875688959327232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796669.786266:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3304:x1875688959327232:12345-0@lo:400:kworker.0 Request processed in 58us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796669.786273:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788796669.786335:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2612f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959327232:0@lo:400:kworker.0 00000100:00100000:1.0:1788796669.786369:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2612f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959327488:0@lo:400:kworker.0 00000100:00100000:1.0:1788796669.786405:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959327616:0@lo:400:kworker.0 00010000:00010000:2.0:1788796669.786572:0:10139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23555 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec50 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.786588:0:10139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe235a2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.786622:0:10139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec50 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.786647:0:10139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23555 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec50 expref: 20 pid: 5846 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796669.786659:0:10139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10139:1875688959327744:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796669.786727:0:10139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb300c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796669.789831:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959327360 00000100:00100000:1.0:1788796669.789847:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959327360 00000100:00100000:1.0:1788796669.789903:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788796669.789922:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959327360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796669.790007:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959327360:12345-0@lo:400:kworker.0 Request processed in 88us (4005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796669.790014:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788796669.790039:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796669.790045:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2612f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959327360:0@lo:400:kworker.0 00000100:00100000:1.0:1788796669.790067:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796669.790089:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959327616 00000100:00100000:0.0:1788796669.790093:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959327616 00000100:00100000:0.0:1788796669.790144:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959327488 00000100:00100000:0.0:1788796669.790148:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959327488 00000100:00100000:0.0:1788796669.790165:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788796669.790171:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959327616:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788796669.790184:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796669.790197:0:5845:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788796669.790205:0:5845:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788796669.790443:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788796669.790444:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959327616:12345-0@lo:400:kworker.0 Request processed in 274us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796669.790451:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959327488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796669.790451:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788796669.790476:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959327616:0@lo:400:kworker.0 00000100:00100000:1.0:1788796669.790707:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959327488:12345-0@lo:400:kworker.0 Request processed in 256us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796669.790725:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788796669.790762:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2612f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959327488:0@lo:400:kworker.0 00000100:00100000:1.0:1788796669.791153:0:10139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10139:1875688959327744:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796669.791182:0:10139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe235a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796669.791405:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796669.791483:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936274304 00000100:00100000:1.0:1788796669.791489:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936274304 00010000:00010000:1.0:1788796669.791515:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23555 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec50 expref: 21 pid: 5846 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796669.791546:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00100000:1.0:1788796669.791561:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+21:2357:x1875688936274304:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788796669.791572:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796669.791579:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23555 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec50 expref: 21 pid: 5846 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.791590:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec50 expref: 21 pid: 5846 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.791613:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe23555 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec50 expref: 21 pid: 5846 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.791625:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd24d573d00) 00010000:00010000:1.0:1788796669.791629:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe235a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.791636:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe235a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.791641:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe235a2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796669.791671:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796669.791703:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+20:2357:x1875688936274304:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 150us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796669.791720:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 83 00010000:00010000:3.0:1788796669.791888:0:10139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe235a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.791894:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe235a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788796669.792052:0:10139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788796669.792172:0:10139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788796669.792231:0:10139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788796669.792311:0:10139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267938e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10139:1875688959327872:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788796669.792362:0:10139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796669.792392:0:10139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d9ae9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796669.792497:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959327872 00000100:00100000:1.0:1788796669.792502:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959327872 00000100:00100000:1.0:1788796669.792550:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788796669.792555:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10139:x1875688959327872:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788796669.792611:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10139:x1875688959327872:12345-0@lo:1000:mdt00_003.0 Request processed in 55us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796669.792618:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788796669.792651:0:10139:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1788796669.792657:0:10139:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1788796669.792674:0:10139:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd26793bb80, transno 4294967321 00000100:00100000:0.0:1788796669.792761:0:10139:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9bd267938700 x1875688959326464/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788796685 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796669.792773:0:10139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267938e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10139:1875688959327872:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788796669.793245:0:10139:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1788796669.793316:0:10139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26130b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10139:1875688959328000:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788796669.793360:0:10139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796669.793390:0:10139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24152b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796669.793539:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959328000 00000100:00100000:3.0:1788796669.793545:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959328000 00000100:00100000:3.0:1788796669.793590:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788796669.793596:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10139:x1875688959328000:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788796669.793778:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:10139:x1875688959328000:12345-0@lo:1000:mdt00_003.0 Request processed in 181us (416us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788796669.793785:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788796669.794130:0:10139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26130b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10139:1875688959328000:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788796669.794163:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe235a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.794173:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe235a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.794181:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe235a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.794187:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796669.794193:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe235a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.794202:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe235a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.794231:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd24d573d00) 00010000:00010000:0.0:1788796669.794234:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788796669.794240:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe235a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.794246:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6600/0xdd273c88cfe235a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.794281:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe234e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.794294:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe234e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.794300:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe234e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.794305:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796669.794308:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe234e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.794314:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe234e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.794322:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:0.0:1788796669.794325:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788796669.794332:0:10139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec34 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.794343:0:10139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec34 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.794352:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec34 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796669.794393:0:10139:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec34 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796669.794405:0:10139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10139:1875688959328128:192.168.201.25@tcp:105: 00000100:00100000:0.0:1788796669.794481:0:10139:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247cc70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796669.796793:0:10139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671cfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10139:1875688959328128:192.168.201.25@tcp:105: 00010000:00010000:3.0:1788796669.796823:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe234e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.796833:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe234e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.796864:0:10139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.796876:0:10139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.796887:0:10139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.796897:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.796903:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.796936:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.796942:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796669.796946:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.796953:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.796964:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:3.0:1788796669.796967:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796669.796970:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.796976:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.796987:0:10139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2359b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.796993:0:10139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2359b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.796999:0:10139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2359b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.797004:0:10139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796669.797007:0:10139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2359b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.797022:0:10139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2359b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.797030:0:10139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:3.0:1788796669.797032:0:10139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788796669.797034:0:10139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2359b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.797040:0:10139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7000/0xdd273c88cfe2359b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10139 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796669.797232:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+23:11592:x1875688936274176:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 12051us (12398us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1788796669.797241:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 229 00000020:00080000:3.0:1788796669.797247:0:10139:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788796669.797576:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788796669.797581:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788796669.799457:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788796669.799472:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788796669.800503:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796669.802937:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.806978:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936274432 00000100:00100000:2.0:1788796669.806995:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936274432 00000100:00100000:2.0:1788796669.807041:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936274688 00000100:00100000:2.0:1788796669.807044:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936274688 00000100:00100000:2.0:1788796669.807060:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:2.0:1788796669.807068:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26793b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+24:11591:x1875688936274432:12345-192.168.201.25@tcp:49:lfs.0 00000100:00100000:2.0:1788796669.807269:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26793b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+24:11591:x1875688936274432:12345-192.168.201.25@tcp:49:lfs.0 Request processed in 140us (6711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796669.807278:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:2.0:1788796669.807295:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:2.0:1788796669.807301:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2504d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+23:11592:x1875688936274688:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788796669.808078:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788796669.808182:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788796669.808293:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.808310:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.808321:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.808341:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.808348:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.808354:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.811341:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788796669.811477:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2504d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+25:11592:x1875688936274688:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 4171us (8542us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788796669.811488:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 62 00000020:00080000:2.0:1788796669.811494:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788796669.817169:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796669.817185:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.817196:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7200 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796669.817201:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.817649:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.817670:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bd24d573400) 00010000:00010000:3.0:1788796669.817673:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788796669.817693:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235b0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.817700:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.817732:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796669.817734:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796669.817736:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796669.819578:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796669.819640:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936274944 00000100:00100000:1.0:1788796669.819652:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936274944 00000100:00100000:1.0:1788796669.819792:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 230 00000100:00100000:1.0:1788796669.819802:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+25:11591:x1875688936274944:12345-192.168.201.25@tcp:58:lfs.0 00000040:00080000:1.0:1788796669.820072:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788796669.820155:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+25:11591:x1875688936274944:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 354us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796669.820163:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 230 00000100:00100000:1.0:1788796669.853264:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.853359:0:12481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936275072 00000100:00100000:2.0:1788796669.853379:0:12481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936275072 00000100:00100000:2.0:1788796669.853442:0:12481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 231 00000100:00100000:2.0:1788796669.853452:0:12481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad2796a3-2145-47da-88fb-baa43721bec1+25:11594:x1875688936275072:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788796669.853479:0:12481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796669.853501:0:12481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe235b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec6c expref: -99 pid: 12481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.853582:0:12481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe235be lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.853598:0:12481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe235be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.853609:0:12481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe235be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.853639:0:12481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.853647:0:12481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.853654:0:12481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.854104:0:12481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.854116:0:12481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec2d expref: 26 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.854125:0:12481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235cc lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.854159:0:12481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec2d expref: 26 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.854174:0:12481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec2d expref: 26 pid: 10139 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796669.854188:0:12481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26793b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12481:1875688959328256:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788796669.854267:0:12481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d9ae000 going to sleep for 11 seconds 00000100:00100000:0.0:1788796669.865598:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796669.866802:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936275328 00000100:00100000:1.0:1788796669.866815:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936275328 00000100:00100000:1.0:1788796669.866886:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:1.0:1788796669.866896:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+27:5597:x1875688936275328:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788796669.867180:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+28:5597:x1875688936275328:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 284us (1589us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788796669.867201:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:3.0:1788796669.872965:0:12481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26793b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12481:1875688959328256:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788796669.872996:0:12481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796669.873058:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796669.873148:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936275456 00000100:00100000:2.0:1788796669.873156:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936275456 00010000:00010000:2.0:1788796669.873195:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec2d expref: 28 pid: 10139 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796669.873234:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:2.0:1788796669.873243:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+28:2358:x1875688936275456:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796669.873259:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796669.873266:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec2d expref: 28 pid: 10139 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.873279:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec2d expref: 28 pid: 10139 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.873301:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6e00/0xdd273c88cfe234d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec2d expref: 28 pid: 10139 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.873318:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:2.0:1788796669.873329:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.873339:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.873348:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235cc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796669.873388:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796669.873448:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad2796a3-2145-47da-88fb-baa43721bec1+27:2358:x1875688936275456:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 205us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796669.873455:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 84 00010000:00010000:3.0:1788796669.874520:0:12481:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.874534:0:12481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796669.874658:0:12481:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788796669.874663:0:12481:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788796669.874689:0:12481:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.874704:0:12481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.874724:0:12481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe235be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.874732:0:12481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe235be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.874739:0:12481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe235be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.874814:0:12481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796669.874819:0:12481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe235be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.874827:0:12481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe235be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.874838:0:12481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:3.0:1788796669.874854:0:12481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796669.874859:0:12481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe235be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.874866:0:12481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6000/0xdd273c88cfe235be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.874881:0:12481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.874886:0:12481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.874891:0:12481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.874896:0:12481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796669.874898:0:12481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.875082:0:12481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.875095:0:12481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bd24d573000) 00010000:00010000:3.0:1788796669.875098:0:12481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796669.875102:0:12481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.875107:0:12481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe235c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.875152:0:12481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe235b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec6c expref: 27 pid: 12481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.875181:0:12481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec6c expref: 26 pid: 12481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796669.875189:0:12481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:3.0:1788796669.875191:0:12481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788796669.875193:0:12481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20800, rc 0) 00000100:00100000:3.0:1788796669.875827:0:12481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad2796a3-2145-47da-88fb-baa43721bec1+26:11594:x1875688936275072:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 22373us (22570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796669.875835:0:12481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 231 00010000:00010000:0.0:1788796670.298012:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796670.298403:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959328384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796670.298481:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796670.298583:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959328384 00000100:00100000:3.0:1788796670.298592:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959328384 00000100:00100000:3.0:1788796670.298665:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788796670.298676:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875688959328384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788796670.298726:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788796670.298825:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788796670.299002:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875688959328384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 329us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796670.299010:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788796670.299072:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959328384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796670.344158:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796670.344193:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796670.344221:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796670.344247:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936275840 00000100:00100000:3.0:1788796670.344257:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936275840 00000100:00100000:3.0:1788796670.344317:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 162 00000100:00100000:3.0:1788796670.344327:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26793b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936275840:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796670.344447:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26793b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2356:x1875688936275840:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 122us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796670.344462:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 162 00000100:00100000:2.0:1788796670.346734:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936275584 00000100:00100000:2.0:1788796670.346781:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936275584 00000100:00100000:2.0:1788796670.346835:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 299 00000100:00100000:2.0:1788796670.346844:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2356:x1875688936275584:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796670.346922:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2356:x1875688936275584:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 78us (2774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796670.346929:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 299 00000100:00100000:2.0:1788796670.346968:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936275712 00000100:00100000:2.0:1788796670.346972:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936275712 00000100:00100000:2.0:1788796670.347005:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 92 00000100:00100000:2.0:1788796670.347012:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+7:2356:x1875688936275712:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796670.347040:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+7:2356:x1875688936275712:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 28us (2818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796670.347046:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 92 00000100:00080000:2.0:1788796670.347081:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788796670.347086:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788796670.401013:0:12519:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788796670.401024:0:12519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788796670.401074:0:12519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788796670.401080:0:12519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788796670.810113:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788796670.810123:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788796670.810167:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788796670.810173:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788796670.810305:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1875688959328512:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788796670.810421:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247cc70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796670.816346:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1875688959328512:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788796670.816643:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796670.816895:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936275968 00000100:00100000:1.0:1788796670.816904:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936275968 00000100:00100000:1.0:1788796670.816970:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 232 00000100:00100000:1.0:1788796670.816980:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26793b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+26:11606:x1875688936275968:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788796670.817013:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788796670.817305:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26793b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+26:11606:x1875688936275968:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 326us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796670.817311:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 232 00000100:00100000:3.0:1788796670.819738:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796670.820046:0:12481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936276224 00000100:00100000:1.0:1788796670.820057:0:12481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936276224 00000100:00100000:1.0:1788796670.820186:0:12481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 233 00000100:00100000:1.0:1788796670.820197:0:12481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26793bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad2796a3-2145-47da-88fb-baa43721bec1+26:11606:x1875688936276224:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788796670.820220:0:12481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796670.820431:0:12481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe235d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec73 expref: -99 pid: 12481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796670.820535:0:12481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe235da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796670.820563:0:12481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe235da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796670.820594:0:12481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe235da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796670.820607:0:12481:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788796670.820742:0:12481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335400/0xdd273c88cfe235d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec73 expref: 29 pid: 12481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796670.820788:0:12481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe235da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec73 expref: 28 pid: 12481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796670.820796:0:12481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:1.0:1788796670.820799:0:12481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796670.820802:0:12481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334400, rc 0) 00000100:00100000:1.0:1788796670.820863:0:12481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26793bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad2796a3-2145-47da-88fb-baa43721bec1+28:11606:x1875688936276224:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 668us (1133us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788796670.820870:0:12481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 233 00000100:00100000:3.0:1788796670.827531:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796670.827598:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936276480 00000100:00100000:2.0:1788796670.827611:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936276480 00000100:00100000:3.0:1788796670.827631:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796670.827685:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 234 00000100:00100000:2.0:1788796670.827740:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+28:11606:x1875688936276480:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788796670.827857:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe235e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796670.827876:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe235e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796670.827887:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe235e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796670.828095:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe235e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796670.828104:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe235e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796670.828111:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe235e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796670.828118:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796670.828123:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe235e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796670.828130:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe235e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796670.828144:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:2.0:1788796670.828163:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788796670.828169:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe235e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796670.828175:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6400/0xdd273c88cfe235e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796670.828390:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad2796a3-2145-47da-88fb-baa43721bec1+29:11606:x1875688936276480:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 696us (868us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788796670.828397:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 234 00000040:00080000:3.0:1788796670.828830:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788796670.828836:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788796670.829370:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788796670.829378:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788796670.831660:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796670.831996:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936276864 00000100:00100000:2.0:1788796670.832007:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936276864 00000100:00100000:2.0:1788796670.832076:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:2.0:1788796670.832088:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+29:11606:x1875688936276864:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788796670.832179:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936276608 00000100:00100000:1.0:1788796670.832186:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936276608 00000100:00100000:1.0:1788796670.832264:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788796670.832274:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+31:2357:x1875688936276608:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788796670.832287:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796670.832311:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334400/0xdd273c88cfe235da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec73 expref: 31 pid: 12481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796670.832329:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:1.0:1788796670.832335:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796670.832399:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+30:11606:x1875688936276864:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 310us (752us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788796670.832399:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad2796a3-2145-47da-88fb-baa43721bec1+30:2357:x1875688936276608:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 123us (4764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796670.832414:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:2.0:1788796670.832418:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00010000:00010000:3.0:1788796671.322003:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796671.835217:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959328640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796671.835291:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796671.835366:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959328640 00000100:00100000:0.0:1788796671.835374:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959328640 00000100:00100000:0.0:1788796671.835429:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788796671.835438:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875688959328640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796671.835488:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796671.837631:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875688959328640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2186us (2331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796671.837647:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1788796671.837697:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796671.837773:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959328640:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788796671.898660:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1788796671.898693:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000040:00080000:2.0:1788796671.953930:0:12571:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788796671.953939:0:12571:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788796671.953980:0:12571:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788796671.953986:0:12571:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788796672.129896:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796672.129948:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936277120 00000100:00100000:1.0:1788796672.129959:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936277120 00000100:00100000:1.0:1788796672.130030:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 235 00000100:00100000:1.0:1788796672.130042:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+29:11626:x1875688936277120:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796672.130072:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796672.130096:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe235ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec7a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796672.130206:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe235f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796672.130223:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe235f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796672.130238:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe235f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796672.130250:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788796672.130383:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335e00/0xdd273c88cfe235ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec7a expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796672.130403:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe235f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec7a expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796672.130412:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:1.0:1788796672.130427:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788796672.130432:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267334600, rc 0) 00000100:00100000:1.0:1788796672.130488:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+31:11626:x1875688936277120:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 449us (603us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788796672.133468:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 235 00000100:00080000:1.0:1788796672.133508:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796672.137899:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796672.137942:0:12481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936277248 00000100:00100000:1.0:1788796672.137954:0:12481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936277248 00000100:00100000:1.0:1788796672.138007:0:12481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 236 00000100:00100000:1.0:1788796672.138017:0:12481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad2796a3-2145-47da-88fb-baa43721bec1+31:11626:x1875688936277248:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:1.0:1788796672.138092:0:12481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23604 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796672.138113:0:12481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796672.138128:0:12481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796672.138160:0:12481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796672.138168:0:12481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23604 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796672.138175:0:12481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796672.138181:0:12481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796672.138187:0:12481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796672.138207:0:12481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23604 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796672.138220:0:12481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:1.0:1788796672.138224:0:12481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796672.138229:0:12481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23604 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796672.138235:0:12481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334e00/0xdd273c88cfe23604 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796672.138309:0:12481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad2796a3-2145-47da-88fb-baa43721bec1+31:11626:x1875688936277248:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 293us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796672.139852:0:12481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 236 00000100:00100000:0.0:1788796672.211847:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796672.212096:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936277376 00000100:00100000:2.0:1788796672.212108:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936277376 00000100:00100000:2.0:1788796672.212185:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00100000:2.0:1788796672.212196:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+7:2357:x1875688936277376:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:2.0:1788796672.212216:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796672.212254:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043069e5b/0xdd273c88cfe2360b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec81 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788796672.212285:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9edefd, atime: 0x6a9edefd, ctime: 0x6a9edefd, blocks: 0xb 00010000:00010000:2.0:1788796672.212308:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=399s v=(0 0) 00010000:00010000:2.0:1788796672.212313:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00000100:00080000:1.0:1788796672.212426:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788796672.212501:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043069e5b/0xdd273c88cfe2360b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec81 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796672.212524:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043069e5b/0xdd273c88cfe2360b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec81 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796672.212538:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7a00, rc 0) 00000100:00100000:2.0:1788796672.212851:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad2796a3-2145-47da-88fb-baa43721bec1+8:2357:x1875688936277376:12345-192.168.201.25@tcp:101:cat.0 Request processed in 656us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796672.212858:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00100000:1.0:1788796672.216853:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796672.216937:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936277504 00000100:00100000:3.0:1788796672.216949:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936277504 00002000:00100000:3.0:1788796672.216997:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9bd261326300 x1875688936277504/t0(0) o3->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:98/0 lens 488/0 e 0 to 0 dl 1788796683 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788796672.217009:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd261326300 with x1875688936277504 ext(0->4095) 00002000:00010000:3.0:1788796672.217014:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd261326300 00000100:00100000:3.0:1788796672.217096:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:3.0:1788796672.217106:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad2796a3-2145-47da-88fb-baa43721bec1+8:2358:x1875688936277504:12345-192.168.201.25@tcp:3:cat.0 00000100:00100000:3.0:1788796672.217331:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad2796a3-2145-47da-88fb-baa43721bec1+8:2358:x1875688936277504:12345-192.168.201.25@tcp:3:cat.0 Request processed in 226us (489us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788796672.217338:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00002000:00100000:3.0:1788796672.217344:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9bd261326300 x1875688936277504/t0(0) o3->ad2796a3-2145-47da-88fb-baa43721bec1@192.168.201.25@tcp:98/0 lens 488/4536 e 0 to 0 dl 1788796683 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788796672.217352:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd261326300 with x1875688936277504 ext(0->4095) 00002000:00010000:3.0:1788796672.217378:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bd261326300 00010000:00010000:0.0:1788796672.345940:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796673.380960:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796674.401880:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796674.908567:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959328768:0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.908643:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796674.908690:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959329280:0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.908713:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796674.908739:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788796674.908761:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959328896:0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.908781:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796674.908797:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959329408:0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.908844:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796674.908873:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959329024:0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.908894:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796674.908913:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796674.908918:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd25037f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959329152:0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.908938:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796674.908967:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959328768 00000100:00100000:2.0:1788796674.908974:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959328768 00000100:00100000:2.0:1788796674.909012:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788796674.909020:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959328768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.909066:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959328768:12345-0@lo:400:kworker.0 Request processed in 47us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796674.909073:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788796674.909100:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959329280 00000100:00100000:2.0:1788796674.909104:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959329280 00000100:00100000:2.0:1788796674.909136:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959328896 00000100:00100000:2.0:1788796674.909139:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959328896 00000100:00100000:2.0:1788796674.909154:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959329024 00000100:00100000:2.0:1788796674.909156:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959329024 00000100:00100000:2.0:1788796674.909171:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788796674.909177:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959329280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.909207:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959329280:12345-0@lo:400:kworker.0 Request processed in 31us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796674.909213:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788796674.909224:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788796674.909230:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959328896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.909255:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959328896:12345-0@lo:400:kworker.0 Request processed in 26us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796674.909267:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788796674.909279:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788796674.909284:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959329024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.909314:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959329024:12345-0@lo:400:kworker.0 Request processed in 30us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796674.909319:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788796674.909336:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959329408 00000100:00100000:2.0:1788796674.909340:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959329408 00000100:00100000:2.0:1788796674.909362:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959329152 00000100:00100000:2.0:1788796674.909365:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959329152 00000100:00100000:2.0:1788796674.909384:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788796674.909390:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959329408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.909418:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959329408:12345-0@lo:400:kworker.0 Request processed in 28us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796674.909424:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788796674.909435:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788796674.909441:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1875688959329152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.909465:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1875688959329152:12345-0@lo:400:kworker.0 Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796674.909470:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1788796674.909514:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788796674.909518:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788796674.909521:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796674.909559:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959329152:0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.909570:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959329024:0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.909596:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959328896:0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.909611:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788796674.909615:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1788796674.909642:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd261295c00, transno 4294967310 00000100:00100000:2.0:1788796674.909652:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959329408:0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.909662:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959328768:0@lo:400:kworker.0 00000100:00100000:2.0:1788796674.909671:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd25037df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959329280:0@lo:400:kworker.0 00000001:00080000:1.0:1788796675.013451:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1788796675.013480:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1788796675.013486:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1788796675.021558:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000020:00080000:0.0:1788796675.021573:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bd249ef2300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788796675.021578:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd247c65200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bd27257cb40 00000020:00080000:0.0:1788796675.021581:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9bd247c65100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bd2612ee400 00000001:00080000:0.0:1788796675.021592:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788796675.021605:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788796675.021700:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788796675.022334:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1788796675.420886:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796675.434383:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788796675.434407:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959329536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796675.434475:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796675.435708:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959329536 00000100:00100000:2.0:1788796675.435721:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959329536 00000100:00100000:2.0:1788796675.435805:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788796675.435816:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959329536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788796675.435852:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796675.435922:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959329536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796675.435929:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788796675.435970:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959329536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796675.472890:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796675.472947:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796675.472980:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796675.472998:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796675.473026:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796675.473061:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936278016 00000100:00100000:2.0:1788796675.473075:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936278016 00000100:00100000:2.0:1788796675.473148:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936277888 00000100:00100000:2.0:1788796675.473159:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936277888 00000100:00100000:2.0:1788796675.473190:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 95 00000100:00100000:2.0:1788796675.473204:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2358:x1875688936278016:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796675.473330:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2358:x1875688936278016:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 129us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796675.473339:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 95 00000100:00100000:2.0:1788796675.473360:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:2.0:1788796675.473367:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936277888:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796675.473393:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936277888:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 27us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796675.473400:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:2.0:1788796675.473419:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936277632 00000100:00100000:2.0:1788796675.473423:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936277632 00000100:00100000:2.0:1788796675.473449:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 301 00000100:00100000:2.0:1788796675.473455:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936277632:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796675.473477:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936277632:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 23us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796675.473484:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 301 00000100:00100000:2.0:1788796675.473517:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936277760 00000100:00100000:2.0:1788796675.473521:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936277760 00000100:00100000:2.0:1788796675.473547:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936278144 00000100:00100000:2.0:1788796675.473551:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936278144 00000100:00100000:2.0:1788796675.473573:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 166 00000100:00100000:2.0:1788796675.473579:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+18:2358:x1875688936277760:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796675.473610:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad2796a3-2145-47da-88fb-baa43721bec1+18:2358:x1875688936277760:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 31us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796675.473629:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 166 00000100:00100000:2.0:1788796675.473641:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00100000:2.0:1788796675.473656:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2358:x1875688936278144:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796675.473682:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2358:x1875688936278144:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 27us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796675.473688:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00080000:2.0:1788796675.473705:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788796675.473712:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788796675.473715:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788796676.443416:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796676.966802:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788796676.966829:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959329664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796676.966901:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796676.966985:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959329664 00000100:00100000:3.0:1788796676.966995:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959329664 00000100:00100000:3.0:1788796676.967052:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788796676.967061:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959329664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788796676.967096:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796676.967142:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959329664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796676.967149:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788796676.967170:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796676.967438:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788796676.967445:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bd267938700, transno 4294967322 00000004:00080000:3.0:1788796676.967458:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1788796676.967493:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959329664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788796677.271517:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796677.271683:0:10139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936278272 00000100:00100000:3.0:1788796677.271694:0:10139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936278272 00000100:00100000:3.0:1788796677.271801:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 237 00000100:00100000:3.0:1788796677.271813:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+18:11272:x1875688936278272:12345-192.168.201.25@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788796677.271919:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+18:11272:x1875688936278272:12345-192.168.201.25@tcp:60:lhsmtool_posix.0 Request processed in 109us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796677.271926:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 237 00000100:00080000:2.0:1788796677.272004:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796677.285106:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796677.285276:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936278528 00000100:00100000:2.0:1788796677.285285:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936278528 00000100:00100000:2.0:1788796677.285347:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:2.0:1788796677.285358:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+18:11272:x1875688936278528:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788796677.285713:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+19:11272:x1875688936278528:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 356us (616us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788796677.285722:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 65 00010000:00010000:2.0:1788796677.466696:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796678.498968:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788796679.002026:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788796679.002037:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788796679.002366:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788796679.002374:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:3.0:1788796679.468462:0:12773:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 11:57:58 (1788796678) 00010000:00010000:2.0:1788796679.514030:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796680.029386:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959329920:0@lo:400:kworker.0 00000100:00100000:1.0:1788796680.029456:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796680.029508:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2612f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959330432:0@lo:400:kworker.0 00000100:00100000:1.0:1788796680.029530:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796680.029570:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788796680.029576:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959329792:0@lo:400:kworker.0 00000100:00100000:1.0:1788796680.029599:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796680.029615:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2612f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959330304:0@lo:400:kworker.0 00000100:00100000:1.0:1788796680.029632:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796680.029652:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959330048:0@lo:400:kworker.0 00000100:00100000:1.0:1788796680.029670:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796680.029687:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788796680.029691:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd261327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959330176:0@lo:400:kworker.0 00000100:00100000:1.0:1788796680.029707:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796680.029768:0:12481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959329920 00000100:00100000:1.0:1788796680.029775:0:12481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959329920 00000100:00100000:1.0:1788796680.029811:0:12481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959330304 00000100:00100000:1.0:1788796680.029814:0:12481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959330304 00000100:00100000:1.0:1788796680.029833:0:12481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959330048 00000100:00100000:1.0:1788796680.029836:0:12481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959330048 00000100:00100000:1.0:1788796680.029849:0:12481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788796680.029856:0:12481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959329920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796680.029900:0:12481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959329920:12345-0@lo:400:kworker.0 Request processed in 44us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796680.029907:0:12481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788796680.029921:0:12481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788796680.029926:0:12481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959330304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796680.029958:0:12481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959330304:12345-0@lo:400:kworker.0 Request processed in 32us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796680.029964:0:12481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788796680.029974:0:12481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788796680.029979:0:12481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959330048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796680.030002:0:12481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959330048:12345-0@lo:400:kworker.0 Request processed in 24us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796680.030007:0:12481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788796680.030022:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959330432 00000100:00100000:1.0:1788796680.030025:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959330432 00000100:00100000:1.0:1788796680.030043:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959330176 00000100:00100000:1.0:1788796680.030045:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959330176 00000100:00100000:1.0:1788796680.030059:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788796680.030064:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959330432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796680.030088:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959330432:12345-0@lo:400:kworker.0 Request processed in 24us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796680.030094:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788796680.030102:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788796680.030107:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959330176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796680.030128:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959330176:12345-0@lo:400:kworker.0 Request processed in 20us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796680.030132:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788796680.030175:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959330176:0@lo:400:kworker.0 00000100:00100000:1.0:1788796680.030184:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959330048:0@lo:400:kworker.0 00000100:00100000:1.0:1788796680.030210:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2612f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959330304:0@lo:400:kworker.0 00000100:00100000:1.0:1788796680.030225:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959329920:0@lo:400:kworker.0 00000100:00100000:1.0:1788796680.030234:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2612f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959330432:0@lo:400:kworker.0 00000100:00100000:2.0:1788796680.032457:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959329792 00000100:00100000:2.0:1788796680.032479:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959329792 00000100:00100000:2.0:1788796680.032518:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788796680.032525:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959329792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796680.032595:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959329792:12345-0@lo:400:kworker.0 Request processed in 70us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796680.032602:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:2.0:1788796680.032629:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788796680.032638:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788796680.032641:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788796680.035872:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd261325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959329792:0@lo:400:kworker.0 00000020:00080000:3.0:1788796680.134422:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1788796680.134444:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788796680.134460:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788796680.134570:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788796680.537866:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796680.554679:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959330560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796680.554771:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796680.554845:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959330560 00000100:00100000:0.0:1788796680.554852:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959330560 00000100:00100000:0.0:1788796680.554887:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788796680.554893:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd24121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959330560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788796680.554922:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796680.554955:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd24121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959330560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796680.554960:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788796680.555002:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959330560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796680.581724:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796680.581795:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796680.581801:0:12481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936278784 00000100:00100000:3.0:1788796680.581811:0:12481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936278784 00000100:00100000:1.0:1788796680.581819:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796680.581838:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796680.581924:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796680.581951:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936278656 00000100:00100000:1.0:1788796680.581955:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936278656 00000100:00100000:3.0:1788796680.586089:0:12481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936279168 00000100:00100000:3.0:1788796680.586103:0:12481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936279168 00000100:00100000:3.0:1788796680.586143:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 171 00000100:00100000:3.0:1788796680.586153:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+18:2357:x1875688936278784:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796680.586241:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad2796a3-2145-47da-88fb-baa43721bec1+18:2357:x1875688936278784:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 90us (4528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796680.586248:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 171 00000100:00100000:3.0:1788796680.586265:0:10139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 172 00000100:00100000:3.0:1788796680.586271:0:10139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2358:x1875688936279168:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796680.586291:0:10139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2358:x1875688936279168:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 21us (4368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796680.586297:0:10139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 172 00000100:00080000:3.0:1788796680.586810:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796680.586937:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 303 00000100:00100000:2.0:1788796680.586946:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936278656:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796680.586968:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2358:x1875688936278656:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 26us (5175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796680.586973:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 303 00000100:00100000:1.0:1788796680.587727:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936279040 00000100:00100000:1.0:1788796680.587735:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936279040 00000100:00100000:1.0:1788796680.587800:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936278912 00000100:00100000:1.0:1788796680.587804:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936278912 00000100:00100000:1.0:1788796680.587826:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:1.0:1788796680.587834:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2612f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2357:x1875688936279040:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796680.588694:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2612f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+5:2357:x1875688936279040:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 858us (6870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796680.588704:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:1.0:1788796680.588721:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:1.0:1788796680.588730:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936278912:12345-192.168.201.25@tcp:400:kworker.0 00000100:00080000:2.0:1788796680.588812:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788796680.588816:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788796680.592922:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad2796a3-2145-47da-88fb-baa43721bec1+7:2358:x1875688936278912:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 4182us (11071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796680.592936:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 100 00010000:00010000:2.0:1788796681.568032:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796682.075328:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796682.075358:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959330688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796682.075420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796682.076616:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959330688 00000100:00100000:3.0:1788796682.076626:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959330688 00000100:00100000:3.0:1788796682.076678:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788796682.076688:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959330688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788796682.076724:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796682.076790:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959330688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796682.076798:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788796682.076816:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796682.076851:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959330688:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788796682.591901:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796682.889078:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796682.889304:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936279296 00000100:00100000:0.0:1788796682.889314:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936279296 00000100:00100000:0.0:1788796682.889398:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 238 00000100:00100000:0.0:1788796682.889410:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+5:12290:x1875688936279296:12345-192.168.201.25@tcp:101:lsof.0 00010000:00010000:0.0:1788796682.889432:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796682.889465:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe23612 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec88 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796682.889546:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23619 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796682.889571:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796682.889585:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796682.889622:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788796682.889625:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788796682.889663:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796682.889688:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4600/0xdd273c88cfe23612 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec88 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796682.889709:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23619 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec88 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796682.889719:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd255d57f00) 00010000:00010000:0.0:1788796682.889728:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788796682.889732:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d4800, rc 0) 00000100:00100000:0.0:1788796682.889855:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+6:12290:x1875688936279296:12345-192.168.201.25@tcp:101:lsof.0 Request processed in 448us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796682.889862:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 238 00000100:00080000:3.0:1788796682.890615:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788796683.612044:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796684.637546:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796684.865253:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796684.865349:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936279552 00000100:00100000:0.0:1788796684.865359:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936279552 00000100:00100000:0.0:1788796684.865433:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 66 00000100:00100000:0.0:1788796684.865445:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+18:12292:x1875688936279552:12345-192.168.201.25@tcp:35:umount.0 00000100:00080000:3.0:1788796684.865857:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796684.866280:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad2796a3-2145-47da-88fb-baa43721bec1+19:12292:x1875688936279552:12345-192.168.201.25@tcp:35:umount.0 Request processed in 835us (1035us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788796684.866289:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 66 00000100:00100000:0.0:1788796684.870645:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796684.870783:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936279808 00000100:00100000:1.0:1788796684.870793:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936279808 00000100:00100000:1.0:1788796684.870848:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:1.0:1788796684.870857:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+19:12292:x1875688936279808:12345-192.168.201.25@tcp:35:umount.0 00000100:00100000:1.0:1788796684.871227:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+20:12292:x1875688936279808:12345-192.168.201.25@tcp:35:umount.0 Request processed in 369us (590us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788796684.871235:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:1.0:1788796684.894488:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796684.896936:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936280064 00000100:00100000:2.0:1788796684.896951:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936280064 00000100:00100000:2.0:1788796684.897026:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:2.0:1788796684.897037:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2504d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+20:12292:x1875688936280064:12345-192.168.201.25@tcp:35:umount.0 00000100:00100000:2.0:1788796684.897315:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2504d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+21:12292:x1875688936280064:12345-192.168.201.25@tcp:35:umount.0 Request processed in 279us (2838us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788796684.897323:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:2.0:1788796684.900628:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796684.901075:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936280320 00000100:00100000:1.0:1788796684.901086:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936280320 00000100:00100000:1.0:1788796684.901146:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:1.0:1788796684.901156:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+21:12292:x1875688936280320:12345-192.168.201.25@tcp:35:umount.0 00000100:00100000:1.0:1788796684.904222:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad2796a3-2145-47da-88fb-baa43721bec1+22:12292:x1875688936280320:12345-192.168.201.25@tcp:35:umount.0 Request processed in 2817us (3354us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788796684.904238:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:2.0:1788796684.911580:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796684.911640:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796684.911674:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796684.911713:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796684.911788:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936280576 00000100:00100000:2.0:1788796684.911798:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936280576 00000100:00100000:2.0:1788796684.911849:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936280832 00000100:00100000:2.0:1788796684.911852:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936280832 00000100:00100000:2.0:1788796684.911865:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936280704 00000100:00100000:2.0:1788796684.911868:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936280704 00000100:00100000:2.0:1788796684.911882:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:2.0:1788796684.911891:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:039faa1e-567a-467b-be0f-2f39bb0eb94e+15:2355:x1875688936280576:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796684.911917:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796684.911936:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd282052e00/0xdd273c88cfe2263d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e81a expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796684.911954:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796684.912002:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:039faa1e-567a-467b-be0f-2f39bb0eb94e+14:2355:x1875688936280576:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 112us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796684.912009:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:2.0:1788796684.912025:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:2.0:1788796684.912031:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:039faa1e-567a-467b-be0f-2f39bb0eb94e+13:2355:x1875688936280832:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796684.912039:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796684.912048:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd267334a00/0xdd273c88cfe22889 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8e5 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796684.912057:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796684.912074:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:2355:x1875688936280832:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 43us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796684.912079:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:2.0:1788796684.912091:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:2.0:1788796684.912097:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd245991850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:2355:x1875688936280704:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796684.912113:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796684.912122:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd282053a00/0xdd273c88cfe22605 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e7e2 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796684.912131:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796684.912306:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936280448 00000100:00100000:0.0:1788796684.912311:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936280448 00000100:00100000:0.0:1788796684.912367:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 72 00000100:00100000:0.0:1788796684.912376:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+5:2354:x1875688936280448:12345-192.168.201.25@tcp:9:umount.0 00000020:00000080:0.0:1788796684.912400:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22977 00000100:00080000:0.0:1788796684.912410:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9bd27cfa9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788796684.912459:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788796684.912712:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad2796a3-2145-47da-88fb-baa43721bec1+2:2354:x1875688936280448:12345-192.168.201.25@tcp:9:umount.0 Request processed in 337us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796684.912719:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 72 00000100:00080000:0.0:1788796684.912737:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788796684.912775:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796684.914444:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd245991850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2355:x1875688936280704:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 2340us (2723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796684.914466:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:2.0:1788796684.919301:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796684.919875:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936281216 00000100:00100000:0.0:1788796684.919886:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936281216 00000100:00100000:0.0:1788796684.919989:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00100000:0.0:1788796684.920000:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+7:2354:x1875688936281216:12345-192.168.201.25@tcp:9:umount.0 00000020:00000080:0.0:1788796684.920032:0:11435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22bd8 00000020:00010000:0.0:1788796684.920041:0:11435:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bd250d2d800: total 0 00000100:00080000:0.0:1788796684.920046:0:11435:0:(import.c:65:import_set_state_nolock()) ffff9bd250d29000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788796684.920092:0:11435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:3.0:1788796684.920538:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:2.0:1788796684.920891:0:5833:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bd250d2d800: total 0 00010000:00010000:2.0:1788796684.920937:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd250d2d800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788796684.920991:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043069e5b/0xdd273c88cfe2360b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec81 expref: 5 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796684.921025:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf1de98/0xdd273c88cfe22f7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaba expref: 4 pid: 11435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796684.921042:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd250d2d800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788796684.921053:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796684.921055:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796684.921056:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796684.921233:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad2796a3-2145-47da-88fb-baa43721bec1+2:2354:x1875688936281216:12345-192.168.201.25@tcp:9:umount.0 Request processed in 1227us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796684.921242:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00100000:1.0:1788796684.937273:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796684.937686:0:12481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936282240 00000100:00100000:3.0:1788796684.937698:0:12481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936282240 00000100:00100000:3.0:1788796684.937796:0:12481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 239 00000100:00100000:3.0:1788796684.937809:0:12481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad2796a3-2145-47da-88fb-baa43721bec1+22:2354:x1875688936282240:12345-192.168.201.25@tcp:39:umount.0 00000020:00000080:3.0:1788796684.937844:0:12481:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22613 00000020:00010000:3.0:1788796684.937861:0:12481:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bd26764a800: total 0 00000100:00080000:3.0:1788796684.937866:0:12481:0:(import.c:65:import_set_state_nolock()) ffff9bd26764f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788796684.937888:0:12481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1788796684.938494:0:12481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad2796a3-2145-47da-88fb-baa43721bec1+21:2354:x1875688936282240:12345-192.168.201.25@tcp:39:umount.0 Request processed in 687us (1231us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788796684.938504:0:12481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 239 00000020:00010000:0.0:1788796684.946004:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bd26764a800: total 0 00010000:00010000:0.0:1788796684.946015:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796684.946080:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd26764a800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788796684.946115:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:0.0:1788796684.946119:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788796684.946130:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe234ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec34 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796684.946170:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:0.0:1788796684.946173:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788796684.946178:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335200/0xdd273c88cfe22feb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ead6 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796684.946191:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:0.0:1788796684.946194:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796684.946197:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe228f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8fa expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796684.946213:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bd255d57500) 00010000:00010000:0.0:1788796684.946230:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788796684.946235:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe232ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eba8 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796684.946257:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:0.0:1788796684.946259:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788796684.946262:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6200/0xdd273c88cfe22f3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eaa5 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796684.946274:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:0.0:1788796684.946276:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788796684.946279:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d5e00/0xdd273c88cfe22f66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eab3 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796684.946292:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:0.0:1788796684.946295:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788796684.946298:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe235cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec6c expref: 14 pid: 12481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796684.946312:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd255d57f00) 00010000:00010000:0.0:1788796684.946315:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788796684.946318:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267335a00/0xdd273c88cfe22fcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eacf expref: 13 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796684.946330:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:0.0:1788796684.946332:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788796684.946336:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334c00/0xdd273c88cfe22c3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e9e1 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796684.946362:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd24d5f1c00) 00010000:00010000:0.0:1788796684.946365:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788796684.946369:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4000/0xdd273c88cfe228dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8f3 expref: 11 pid: 10139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796684.946386:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bd255d57e00) 00010000:00010000:0.0:1788796684.946388:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788796684.946392:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21000/0xdd273c88cfe22e5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ea6d expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796684.946407:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bd255d57600) 00010000:00010000:0.0:1788796684.946409:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788796684.946413:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334200/0xdd273c88cfe2294d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e90f expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796684.946428:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bd24712b900) 00010000:00010000:0.0:1788796684.946430:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788796684.946434:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd267334600/0xdd273c88cfe235f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec7a expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796684.946458:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd26764a800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788796684.946472:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796684.946474:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796684.946476:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796685.146249:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959331072:0@lo:400:kworker.0 00000100:00100000:0.0:1788796685.146319:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796685.146408:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796685.146415:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959331200:0@lo:400:kworker.0 00000100:00100000:0.0:1788796685.146440:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796685.146482:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959331072 00000100:00100000:0.0:1788796685.146490:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959331072 00000100:00100000:0.0:1788796685.146560:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788796685.146570:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959331072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796685.146622:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959331072:12345-0@lo:400:kworker.0 Request processed in 54us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796685.146630:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788796685.146901:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959331072:0@lo:400:kworker.0 00000100:00100000:0.0:1788796685.146925:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959331200 00000100:00100000:0.0:1788796685.146929:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959331200 00000100:00100000:0.0:1788796685.146957:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788796685.146963:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959331200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796685.147119:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959331200:12345-0@lo:400:kworker.0 Request processed in 155us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796685.147125:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788796685.147166:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959331200:0@lo:400:kworker.0 00000100:00100000:3.0:1788796685.148592:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959330816:0@lo:400:kworker.0 00000100:00100000:3.0:1788796685.148653:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796685.148688:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959331328:0@lo:400:kworker.0 00000100:00100000:3.0:1788796685.149464:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796685.149504:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788796685.149512:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eb1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959330944:0@lo:400:kworker.0 00000100:00100000:3.0:1788796685.149539:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796685.149559:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959331456:0@lo:400:kworker.0 00000100:00100000:3.0:1788796685.149584:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788796685.149612:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788796685.149619:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796685.149657:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959330816 00000100:00100000:3.0:1788796685.149665:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959330816 00000100:00100000:3.0:1788796685.149710:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788796685.149718:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959330816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796685.149783:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+19:3306:x1875688959330816:12345-0@lo:400:kworker.0 Request processed in 66us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796685.149790:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788796685.149831:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959330816:0@lo:400:kworker.0 00000100:00100000:3.0:1788796685.149854:0:12481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959331328 00000100:00100000:3.0:1788796685.149858:0:12481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959331328 00000100:00100000:3.0:1788796685.149886:0:12481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959330944 00000100:00100000:3.0:1788796685.149890:0:12481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959330944 00000100:00100000:3.0:1788796685.149909:0:12481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788796685.149915:0:12481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959331328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796685.149953:0:12481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959331328:12345-0@lo:400:kworker.0 Request processed in 38us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796685.149959:0:12481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788796685.149972:0:12481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788796685.149978:0:12481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959330944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796685.150005:0:12481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959330944:12345-0@lo:400:kworker.0 Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796685.150018:0:12481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:3.0:1788796685.150033:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796685.150051:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eb1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959330944:0@lo:400:kworker.0 00000100:00100000:3.0:1788796685.150061:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959331328:0@lo:400:kworker.0 00000100:00100000:3.0:1788796685.150086:0:11435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959331456 00000100:00100000:3.0:1788796685.150089:0:11435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959331456 00000100:00100000:3.0:1788796685.150120:0:11435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788796685.150126:0:11435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959331456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796685.150163:0:11435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959331456:12345-0@lo:400:kworker.0 Request processed in 37us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796685.150169:0:11435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1788796685.150184:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788796685.150200:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959331456:0@lo:400:kworker.0 00000001:00100000:1.0:1788796685.229609:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad2796a3-2145-47da-88fb-baa43721bec1 00000020:00000080:1.0:1788796685.229617:0:6716:0:(genops.c:885:class_export_put()) final put ffff9bd250d2d800/ad2796a3-2145-47da-88fb-baa43721bec1 00000020:00000080:0.0:1788796685.229710:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd250d2d800/ad2796a3-2145-47da-88fb-baa43721bec1 for lustre-OST0000 00000020:00000080:0.0:1788796685.229783:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd250d29000 for lustre-OST0000 00000001:00080000:0.0:1788796685.240636:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000001:00080000:0.0:1788796685.240655:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1788796685.240668:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ad2796a3-2145-47da-88fb-baa43721bec1 00000001:00080000:0.0:1788796685.240674:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1788796685.240677:0:5866:0:(genops.c:885:class_export_put()) final put ffff9bd26764a800/ad2796a3-2145-47da-88fb-baa43721bec1 00000020:00000080:3.0:1788796685.240955:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd26764a800/ad2796a3-2145-47da-88fb-baa43721bec1 for lustre-MDT0000 00000020:00000080:3.0:1788796685.241087:0:12649:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd26764f800 for lustre-MDT0000 00010000:00010000:3.0:1788796685.659814:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796685.659996:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959331584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796685.660064:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796685.660196:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959331584 00000100:00100000:3.0:1788796685.660207:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959331584 00000100:00100000:3.0:1788796685.660258:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788796685.660268:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd25037f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959331584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788796685.660304:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796685.660358:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd25037f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959331584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796685.660376:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788796685.660515:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959331584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796685.703645:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796685.703705:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796685.704032:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936282496 00000100:00100000:0.0:1788796685.704044:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936282496 00000100:00100000:0.0:1788796685.704127:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 176 00000100:00100000:0.0:1788796685.704137:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+6:2357:x1875688936282496:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796685.704213:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a379f77-5f92-452d-b05c-5aa06b68e964+6:2357:x1875688936282496:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 77us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796685.704221:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 176 00000100:00100000:1.0:1788796685.704458:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936282368 00000100:00100000:1.0:1788796685.704463:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936282368 00000100:00100000:1.0:1788796685.704503:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 305 00000100:00100000:1.0:1788796685.704510:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2357:x1875688936282368:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796685.704554:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2357:x1875688936282368:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 34us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796685.704560:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 305 00000100:00080000:3.0:1788796685.705964:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788796686.681903:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796687.198388:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959331712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796687.198480:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796687.198542:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959331712 00000100:00100000:1.0:1788796687.198563:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959331712 00000100:00100000:1.0:1788796687.198639:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788796687.198649:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959331712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796687.198683:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796687.198817:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959331712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796687.198824:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788796687.199759:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796687.199811:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959331712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796687.240619:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796687.240658:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796687.240915:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796687.240945:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936282752 00000100:00100000:2.0:1788796687.240954:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936282752 00000100:00100000:2.0:1788796687.241004:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936282880 00000100:00100000:2.0:1788796687.241007:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936282880 00000100:00100000:2.0:1788796687.241020:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936282624 00000100:00100000:2.0:1788796687.241022:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936282624 00000100:00100000:2.0:1788796687.241039:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:2.0:1788796687.241048:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26c620380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:2355:x1875688936282752:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796687.241064:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788796687.241179:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:3.0:1788796687.241190:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:039faa1e-567a-467b-be0f-2f39bb0eb94e+12:2357:x1875688936282880:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796687.241200:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796687.241217:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d21600/0xdd273c88cfe226e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e82f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796687.241234:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796687.241282:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:039faa1e-567a-467b-be0f-2f39bb0eb94e+11:2357:x1875688936282880:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 95us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796687.241290:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:3.0:1788796687.241309:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:3.0:1788796687.241317:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:039faa1e-567a-467b-be0f-2f39bb0eb94e+10:2356:x1875688936282624:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796687.241325:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796687.241333:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe226ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e859 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796687.241342:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796687.241359:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:039faa1e-567a-467b-be0f-2f39bb0eb94e+9:2356:x1875688936282624:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 43us (444us total) trans 0 rc 0/0 00010000:00010000:2.0:1788796687.241635:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe22882 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e8de expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796687.241647:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796687.241680:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26c620380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:039faa1e-567a-467b-be0f-2f39bb0eb94e+8:2355:x1875688936282752:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 633us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796687.241688:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:3.0:1788796687.241773:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:3.0:1788796687.249002:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796687.249034:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936283136 00000100:00100000:0.0:1788796687.249046:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936283136 00000100:00100000:0.0:1788796687.249113:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 240 00000100:00100000:0.0:1788796687.249123:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+6:2354:x1875688936283136:12345-192.168.201.25@tcp:39:umount.0 00000020:00000080:0.0:1788796687.249164:0:5845:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe226fa 00000020:00010000:0.0:1788796687.249187:0:5845:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bd27ce2a000: total 0 00000100:00080000:0.0:1788796687.249193:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9bd27ce2b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788796687.249219:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00080000:3.0:1788796687.249349:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796687.249639:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a379f77-5f92-452d-b05c-5aa06b68e964+5:2354:x1875688936283136:12345-192.168.201.25@tcp:39:umount.0 Request processed in 517us (648us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788796687.249648:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 240 00000020:00010000:0.0:1788796687.249697:0:5833:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bd27ce2a000: total 0 00010000:00010000:0.0:1788796687.249776:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd27ce2a000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788796687.249810:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd255d57f00) 00010000:00010000:0.0:1788796687.249814:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788796687.249822:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2821d4800/0xdd273c88cfe23619 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec88 expref: 4 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796687.249842:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd27ce2a000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788796687.249863:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796687.249865:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796687.249867:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788796687.255355:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ad2796a3-2145-47da-88fb-baa43721bec1 00000020:00000080:3.0:1788796687.255363:0:7649:0:(genops.c:885:class_export_put()) final put ffff9bd27cfad800/ad2796a3-2145-47da-88fb-baa43721bec1 00000020:00000080:2.0:1788796687.255449:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27cfad800/ad2796a3-2145-47da-88fb-baa43721bec1 for lustre-OST0001 00000020:00000080:2.0:1788796687.255579:0:12649:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd27cfa9000 for lustre-OST0001 00000100:00100000:1.0:1788796687.272185:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796687.272283:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936283392 00000100:00100000:3.0:1788796687.272294:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936283392 00000100:00100000:3.0:1788796687.272352:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 306 00000100:00100000:3.0:1788796687.272364:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd250246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+7:2354:x1875688936283392:12345-192.168.201.25@tcp:251:umount.0 00000020:00000080:3.0:1788796687.272834:0:5838:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe225f0 00000020:00010000:3.0:1788796687.272843:0:5838:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bd27d146800: total 0 00000100:00080000:3.0:1788796687.272848:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9bd27d142000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788796687.272921:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd250246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:039faa1e-567a-467b-be0f-2f39bb0eb94e+3:2354:x1875688936283392:12345-192.168.201.25@tcp:251:umount.0 Request processed in 558us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796687.272930:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 306 00000020:00010000:0.0:1788796687.273542:0:5832:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bd27d146800: total 0 00010000:00010000:0.0:1788796687.273548:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796687.273596:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd27d146800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788796687.273629:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd282053400/0xdd273c88cfe22644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65e821 expref: 2 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796687.273644:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd27d146800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788796687.273654:0:5832:0:(genops.c:885:class_export_put()) final put ffff9bd27d146800/039faa1e-567a-467b-be0f-2f39bb0eb94e 00010000:00010000:0.0:1788796687.273674:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796687.273676:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796687.273678:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788796687.273715:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27d146800/039faa1e-567a-467b-be0f-2f39bb0eb94e for MGS 00000020:00000080:3.0:1788796687.273788:0:12649:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd27d142000 for MGS 00010000:00010000:0.0:1788796687.708552:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796688.730416:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788796689.244140:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788796689.244148:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788796689.244528:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788796689.244546:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000004:1.0:1788796689.651808:0:12972:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788796689.677615:0:12972:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788796689.677666:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.677681:0:12972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe226b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.677688:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe226b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.677694:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe226b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.677972:0:12972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788796689.677978:0:12972:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788796689.678001:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788796689.678005:0:12972:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788796689.678010:0:12972:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1788796689.678011:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796689.678018:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe226b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796689.678025:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335800 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:3.0:1788796689.678028:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe226b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788796689.678033:0:12972:0:(import.c:65:import_set_state_nolock()) ffff9bd27cd7a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788796689.678036:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd273c88cfe226b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788796689.678043:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd273c88cfe226b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796689.678067:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788796689.678070:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788796689.678073:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788796689.678099:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe226b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796689.678105:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788796689.678138:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe226b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796689.678146:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd267335800/0xdd273c88cfe226ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe226b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796689.678158:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796689.678160:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796689.678162:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796689.678170:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788796689.678189:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959331968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788796689.678265:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796689.686793:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875688959331840:0@lo:39:umount.0 00000100:00100000:2.0:1788796689.686880:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796689.686951:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959331968 00000100:00100000:2.0:1788796689.686960:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959331968 00000100:00100000:2.0:1788796689.687022:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788796689.687030:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f7145a2-0840-45a5-acde-da959fc7802f+19:3307:x1875688959331968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788796689.687043:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796689.687062:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd267335600/0xdd273c88cfe226b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd273c88cfe226ad expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796689.687100:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796689.687153:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f7145a2-0840-45a5-acde-da959fc7802f+18:3307:x1875688959331968:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (8876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796689.687161:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788796689.687201:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959331968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788796689.687386:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959331840 00000100:00100000:0.0:1788796689.687390:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959331840 00000100:00100000:0.0:1788796689.687428:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788796689.687436:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875688959331840:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788796689.687461:0:5844:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe223ff 00000100:00080000:0.0:1788796689.687469:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9bd24a690800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788796689.687534:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1875688959331840:12345-0@lo:39:umount.0 Request processed in 98us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796689.687540:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:0.0:1788796689.687545:0:5844:0:(genops.c:885:class_export_put()) final put ffff9bd24a697800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788796689.687575:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd24a697800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788796689.687612:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd24a690800 for lustre-MDT0000 00010000:00010000:3.0:1788796689.689116:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788796689.692343:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd27cd7a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788796689.692375:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875688959331840:0@lo:39:umount.0 00000100:00080000:1.0:1788796689.693480:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788796689.693503:0:12972:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788796689.693522:0:12972:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788796689.696509:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe226c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.697983:0:12972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe226c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.697992:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe226c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.698000:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe226c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.698028:0:12972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788796689.698035:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe225b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.698042:0:12972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe225b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.698048:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe225b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.698055:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe225b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.698165:0:12972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788796689.698177:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe228b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.698206:0:12972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe228b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.698213:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe228b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.698220:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe228b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.705123:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788796689.707317:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe226c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.707336:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240030400 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796689.707342:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe226c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.707353:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd273c88cfe226c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796689.707361:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd273c88cfe226c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796689.707398:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788796689.707409:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788796689.707451:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe226c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.707458:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796689.707500:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe226c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.707508:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd240030400/0xdd273c88cfe226bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe226c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.707526:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788796689.707530:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe225b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.707553:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4a00 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796689.707556:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe225b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.707562:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd273c88cfe225b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796689.707568:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd273c88cfe225b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796689.707572:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788796689.707575:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788796689.707578:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788796689.707594:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe225b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.707600:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796689.707616:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe225b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.707623:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4a00/0xdd273c88cfe225aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe225b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.707637:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796689.707641:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe228b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.707646:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21e00 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796689.707649:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe228b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.707661:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd273c88cfe228b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796689.707667:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd273c88cfe228b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796689.707671:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788796689.707673:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788796689.707685:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe228b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.707692:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788796689.707804:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959332096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796689.707885:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796689.707955:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959332096 00000100:00100000:2.0:1788796689.707962:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959332096 00000100:00100000:2.0:1788796689.708011:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788796689.708021:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27d7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f7145a2-0840-45a5-acde-da959fc7802f+18:3307:x1875688959332096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788796689.708034:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796689.708047:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd267334800/0xdd273c88cfe226c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd273c88cfe226bb expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796689.708060:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796689.708094:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27d7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f7145a2-0840-45a5-acde-da959fc7802f+17:3307:x1875688959332096:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796689.708102:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788796689.708154:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959332096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788796689.708317:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe228b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.708327:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796689.708329:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796689.708331:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796689.709472:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959332352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796689.709520:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796689.709582:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788796689.709589:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959332224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796689.709614:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796689.709644:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959332352 00000100:00100000:2.0:1788796689.709651:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959332352 00000100:00100000:2.0:1788796689.709685:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959332224 00000100:00100000:2.0:1788796689.709688:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959332224 00000100:00100000:2.0:1788796689.709787:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788796689.709796:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f7145a2-0840-45a5-acde-da959fc7802f+18:3305:x1875688959332352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788796689.709808:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796689.709823:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd2466b7800/0xdd273c88cfe228b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd273c88cfe228ac expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796689.709837:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788796689.709857:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796689.710116:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788796689.710126:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd245991c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+17:3305:x1875688959332224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788796689.710136:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788796689.710346:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f7145a2-0840-45a5-acde-da959fc7802f+17:3305:x1875688959332352:12345-0@lo:103:ldlm_bl.0 Request processed in 551us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796689.710354:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1788796689.710477:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd240031a00/0xdd273c88cfe225b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd273c88cfe225aa expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.710490:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796689.710521:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd245991c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f7145a2-0840-45a5-acde-da959fc7802f+15:3305:x1875688959332224:12345-0@lo:103:ldlm_bl.0 Request processed in 398us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796689.710528:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788796689.711050:0:12972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788796689.711060:0:12972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd247d21e00/0xdd273c88cfe228ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe228b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796689.711074:0:12972:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788796689.711204:0:12972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240031000/0xdd273c88cfe2235e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.711214:0:12972:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240031000/0xdd273c88cfe2235e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.711221:0:12972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd240031000/0xdd273c88cfe2235e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe22365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.711229:0:12972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff9bd240031000/0xdd273c88cfe2235e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe22365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796689.711246:0:12972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788796689.711250:0:12972:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788796689.711253:0:12972:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788796689.711288:0:12972:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788796689.711292:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788796689.711296:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788796689.711302:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1788796689.711307:0:12972:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9bd27d143000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788796689.711313:0:12972:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9bd26769d800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788796689.711320:0:12972:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9bd27ce2a000 7a379f77-5f92-452d-b05c-5aa06b68e964 192.168.201.25@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788796689.711325:0:12972:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9bd2466ccd28) has exports, disconnecting them 00000020:00080000:1.0:1788796689.711329:0:12972:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bd27d143000), last request at 1788796685 00000020:00000080:1.0:1788796689.711337:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22572 00000100:00080000:1.0:1788796689.711353:0:12972:0:(import.c:65:import_set_state_nolock()) ffff9bd27d145000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788796689.711404:0:12972:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd27d143000): rc 0 00000020:00000080:1.0:1788796689.711407:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd27d143000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:0.0:1788796689.711963:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796689.711971:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd240031000/0xdd273c88cfe2235e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe22365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.711979:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031000 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796689.711982:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd240031000/0xdd273c88cfe2235e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe22365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.711990:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd240031000/0xdd273c88cfe2235e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd273c88cfe22365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796689.711997:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd240031000/0xdd273c88cfe2235e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd273c88cfe22365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796689.712003:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788796689.712005:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788796689.712007:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788796689.712033:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd240031000/0xdd273c88cfe2235e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe22365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.712039:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788796689.723101:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796689.732032:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959332224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796689.732050:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:3305:1875688959332352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796689.732837:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959332480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796689.732923:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796689.733122:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959332480 00000100:00100000:3.0:1788796689.733131:0:8457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959332480 00000100:00100000:3.0:1788796689.733219:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788796689.733230:0:8457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f7145a2-0840-45a5-acde-da959fc7802f+15:3306:x1875688959332480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788796689.733251:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796689.733281:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd282052c00/0xdd273c88cfe22365 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd273c88cfe2235e expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796689.733330:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796689.733378:0:8457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f7145a2-0840-45a5-acde-da959fc7802f+14:3306:x1875688959332480:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796689.733385:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788796689.733975:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959332480:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788796689.747930:0:12972:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bd26769d800), last request at 1788796685 00000020:00000080:1.0:1788796689.747944:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe224a7 00000100:00080000:1.0:1788796689.747960:0:12972:0:(import.c:65:import_set_state_nolock()) ffff9bd26769d000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788796689.748055:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788796689.748130:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27d143000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788796689.748198:0:12649:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd27d145000 for lustre-MDT0000 00000020:00080000:2.0:1788796689.748216:0:12972:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd26769d800): rc 0 00000020:00000080:2.0:1788796689.748219:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd26769d800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788796689.748258:0:12972:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4d043b1fae0 00000020:00000080:3.0:1788796689.748281:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd26769d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:2.0:1788796689.748281:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788796689.748284:0:12972:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788796689.748297:0:12972:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:3.0:1788796689.748320:0:12649:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd26769d000 for lustre-MDT0000 00000100:00080000:2.0:1788796689.748376:0:12972:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788796689.748405:0:12972:0:(import.c:65:import_set_state_nolock()) ffff9bd250290800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788796689.748427:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788796689.748430:0:12972:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788796689.748440:0:12972:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788796689.748495:0:12972:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788796689.748504:0:12972:0:(import.c:65:import_set_state_nolock()) ffff9bd26717a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788796689.748514:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959332608:0@lo:9:umount.0 00000020:00080000:2.0:1788796689.748537:0:12972:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9bd2466ccd28) has no exports 00000100:00100000:3.0:1788796689.748587:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796689.748638:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959332736:0@lo:9:umount.0 00000100:00100000:3.0:1788796689.748662:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796689.748797:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959332608 00000100:00100000:3.0:1788796689.748805:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959332608 00000100:00100000:3.0:1788796689.748850:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959332736 00000100:00100000:3.0:1788796689.748853:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959332736 00000100:00100000:3.0:1788796689.748877:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788796689.748885:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875688959332608:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788796689.748917:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe224f4 00000100:00080000:3.0:1788796689.748924:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9bd27ce2a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788796689.748954:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788796689.749277:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3303:x1875688959332608:12345-0@lo:9:umount.0 Request processed in 392us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796689.749283:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788796689.749447:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788796689.749455:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875688959332736:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788796689.749469:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe225e9 00000100:00080000:2.0:1788796689.749474:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9bd2503a9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788796689.749492:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:3.0:1788796689.749532:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788796689.749536:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788796689.749567:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd250290800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788796689.749577:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788796689.749587:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788796689.749591:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959332608:0@lo:9:umount.0 00010000:00010000:3.0:1788796689.749614:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796689.749710:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3303:x1875688959332736:12345-0@lo:9:umount.0 Request processed in 256us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796689.749717:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788796689.751568:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd26717a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788796689.751592:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788796689.751595:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788796689.751600:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959332736:0@lo:9:umount.0 00010000:00010000:0.0:1788796689.754324:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd240031000/0xdd273c88cfe2235e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe22365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796689.754342:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd240031000/0xdd273c88cfe2235e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe22365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796689.755012:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796689.755775:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796689.755779:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796689.755781:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788796689.803351:0:12972:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9bd2466ccd28) has no exports 00000020:00000080:2.0:1788796689.953562:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe223b9 00000020:00000080:2.0:1788796689.953579:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd27cd78000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788796689.953604:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788796689.953785:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27cd78000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788796689.960825:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788796689.960841:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788796689.960846:0:12972:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9bd246070000) has no exports 00000020:00000080:3.0:1788796689.965228:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe223b2 00000020:00000080:3.0:1788796689.965242:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd26117c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788796689.965306:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788796689.965317:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788796689.965320:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd27cd55800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788796689.965322:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd26117c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788796689.965323:0:12972:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27cd55800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788796689.965331:0:12972:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:1.0:1788796690.266930:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875688959333120:0@lo:400:kworker.0 00000100:00100000:1.0:1788796690.267022:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796690.267092:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788796690.267098:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959332992:0@lo:400:kworker.0 00000100:00100000:1.0:1788796690.267122:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796690.267157:0:12481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959333120 00000100:00100000:1.0:1788796690.267165:0:12481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959333120 00000100:00100000:1.0:1788796690.267195:0:12481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959332992 00000100:00100000:1.0:1788796690.267198:0:12481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959332992 00000100:00100000:1.0:1788796690.267214:0:12481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788796690.267228:0:12481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3305:x1875688959333120:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788796690.267237:0:12481:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788796690.267277:0:12481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3305:x1875688959333120:12345-0@lo:400:kworker.0 Request processed in 49us (255us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788796690.267284:0:12481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788796690.267302:0:12481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788796690.267307:0:12481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3305:x1875688959332992:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788796690.267310:0:12481:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788796690.267332:0:12481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3305:x1875688959332992:12345-0@lo:400:kworker.0 Request processed in 24us (209us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788796690.267337:0:12481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1788796690.267379:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788796690.267384:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9bd26769f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788796690.267387:0:3305:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788796690.267644:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796690.267656:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959332864:0@lo:400:kworker.0 00000100:00100000:3.0:1788796690.267694:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796690.273029:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959332864 00000100:00100000:0.0:1788796690.273046:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959332864 00000100:00100000:0.0:1788796690.273101:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788796690.273112:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd249a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:3306:x1875688959332864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796690.273219:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd249a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f7145a2-0840-45a5-acde-da959fc7802f+14:3306:x1875688959332864:12345-0@lo:400:kworker.0 Request processed in 109us (5524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796690.273226:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788796690.273308:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7f7145a2-0840-45a5-acde-da959fc7802f:3306:1875688959332864:0@lo:400:kworker.0 00000100:00080000:1.0:1788796690.311966:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9bd26769f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788796690.311980:0:3305:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 206 00000100:00080000:1.0:1788796690.311996:0:3305:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bd26769f800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1788796690.312144:0:3305:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27e3c9f80 x1875688959333248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788796690.312175:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959332992:0@lo:400:kworker.0 00000100:00100000:1.0:1788796690.312201:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875688959333248:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788796690.316040:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796690.316100:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959333248 00000100:00100000:1.0:1788796690.316109:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959333248 00000100:00100000:1.0:1788796690.316142:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788796690.316162:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875688959333248:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788796690.316181:0:5846:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1788796690.320369:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788796690.320378:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9bd267179000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788796690.320382:0:3305:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788796690.320388:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9bd267179000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788796690.320392:0:3305:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 227 00000100:00080000:0.0:1788796690.320406:0:3305:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd267179000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1788796690.320452:0:3305:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27e379880 x1875688959333376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788796690.320485:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875688959333120:0@lo:400:kworker.0 00000100:00100000:3.0:1788796690.320730:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875688959333376:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788796690.320819:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796690.322119:0:12481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959333376 00000100:00100000:2.0:1788796690.322131:0:12481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959333376 00000100:00100000:2.0:1788796690.322180:0:12481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788796690.322188:0:12481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3303:x1875688959333376:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788796690.324679:0:12481:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788796690.324794:0:12481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3303:x1875688959333376:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 2603us (3972us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788796690.324806:0:12481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1788796690.325824:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd267179000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788796690.325833:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788796690.325838:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875688959333376:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788796690.346979:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875688959333248:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 30812us (30941us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788796690.346993:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1788796690.347046:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd26769f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788796690.347051:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788796690.347055:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875688959333248:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:0.0:1788796690.376392:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a379f77-5f92-452d-b05c-5aa06b68e964 00000001:00080000:0.0:1788796690.376407:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788796690.376414:0:5866:0:(genops.c:885:class_export_put()) final put ffff9bd27ce2a000/7a379f77-5f92-452d-b05c-5aa06b68e964 00000020:00000080:0.0:1788796690.376439:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27ce2a000/7a379f77-5f92-452d-b05c-5aa06b68e964 for lustre-MDT0000 00000020:00000080:0.0:1788796690.376840:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd27ce2b000 for lustre-MDT0000 00000001:00100000:3.0:1788796690.434162:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788796690.434172:0:6716:0:(genops.c:885:class_export_put()) final put ffff9bd27ce2b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788796690.434931:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27ce2b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788796690.434977:0:12649:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd27ce2a800 for lustre-OST0000 00010000:00010000:3.0:1788796690.779802:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796691.802428:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788796691.994038:0:12972:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd27cd122a0 - data ffff9bd1415cb288/ffff9bd2672cc400 00000020:01000000:3.0:1788796691.994230:0:12972:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd247fb74e0 - data ffff9bd28077cbd0/ffff9bd247cd9400 00000001:00000004:3.0:1788796692.011092:0:12972:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:1.0:1788796692.194895:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788796692.194903:0:12972:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1788796692.194925:0:12972:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788796692.194928:0:12972:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788796692.195965:0:6805:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788796692.195971:0:6805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1788796692.195981:0:6805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788796692.199846:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788796692.199854:0:12972:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1788796692.199873:0:12972:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788796692.199876:0:12972:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788796692.200562:0:7927:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788796692.200568:0:7927:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788796692.200577:0:7927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788796692.333860:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22381 00000020:00000080:2.0:1788796692.333872:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd27ecc5000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788796692.335819:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27ecc5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788796692.339605:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22396 00000020:00000080:3.0:1788796692.339620:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd27ecc7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788796692.339644:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788796692.339650:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788796692.339658:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788796692.339663:0:12972:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9bd2466cb370) has no exports 00000004:01000000:3.0:1788796692.340011:0:12972:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788796692.340020:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe225d4 00000020:00000080:3.0:1788796692.340025:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd27d143800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788796692.340030:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788796692.340034:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788796692.340041:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788796692.340044:0:12972:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9bd27cfbb370) has no exports 00000020:00000080:3.0:1788796692.340051:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe225cd 00000020:00000080:3.0:1788796692.340055:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd26717b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788796692.340153:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27ecc7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00010000:01000000:3.0:1788796692.340503:0:12972:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788796692.340508:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788796692.340512:0:12972:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1788796692.340518:0:12972:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788796692.340520:0:12972:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788796692.340563:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788796692.340571:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788796692.340576:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe224ed 00000020:00000080:3.0:1788796692.340582:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd27ce2e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788796692.340586:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788796692.340590:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788796692.340594:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:2.0:1788796692.340598:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27d143800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788796692.340605:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd26717b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1788796692.340610:0:12972:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9bd27cfb99b8) has no exports 00000020:00000080:2.0:1788796692.340614:0:12649:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd26717a000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788796692.340617:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe224e6 00000020:00000080:2.0:1788796692.340622:0:12649:0:(genops.c:885:class_export_put()) final put ffff9bd27d141800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788796692.340623:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd250293000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788796692.340627:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27d141800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788796692.340634:0:12649:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788796692.340713:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27ce2e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788796692.340724:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd250293000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788796692.341193:0:12972:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788796692.341197:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788796692.341199:0:12972:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1788796692.341202:0:12972:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788796692.341204:0:12972:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788796692.341222:0:12649:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd250290800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788796692.341334:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788796692.341341:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788796692.341345:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd250296000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788796692.341348:0:12972:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd250296000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788796692.341354:0:12972:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788796692.341476:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788796692.341481:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788796692.341484:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd2525d4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788796692.341486:0:12972:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd2525d4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788796692.341490:0:12972:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788796692.341604:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe2239d 00000020:00000080:3.0:1788796692.341610:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd27ecc6000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788796692.341621:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788796692.341629:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27ecc6000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788796692.341638:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788796692.341643:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788796692.341646:0:12972:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9bd2466c99b8) has no exports 00000020:00000080:3.0:1788796692.341665:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788796692.341680:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788796692.341683:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd27ecc2000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788796692.341685:0:12972:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27ecc2000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788796692.341689:0:12972:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788796692.341939:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe223a4 00000020:00000080:3.0:1788796692.341944:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd27ecc4800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788796692.341967:0:12972:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd250afa000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788796692.341970:0:12972:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd250afa000 3 00000020:01000004:3.0:1788796692.341973:0:12972:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd250afa000 from lustre-MDT0000 00000020:00000080:3.0:1788796692.341993:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788796692.341997:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788796692.342000:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd27ecc5800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788796692.342002:0:12972:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27ecc5800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788796692.342009:0:12972:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788796692.342037:0:12972:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788796692.342042:0:12972:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788796692.342045:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788796692.342047:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788796692.342049:0:12972:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788796692.342055:0:12972:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9bd24605b800 7f7145a2-0840-45a5-acde-da959fc7802f 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788796692.342061:0:12972:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9bd2466c8000) has exports, disconnecting them 00000020:00080000:3.0:1788796692.342065:0:12972:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9bd24605b800), last request at 1788796460 00000020:00000080:3.0:1788796692.342080:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22342 00000020:00010000:3.0:1788796692.342084:0:12972:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9bd24605b800: total 1 00000100:00080000:3.0:1788796692.342088:0:12972:0:(import.c:65:import_set_state_nolock()) ffff9bd24605e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788796692.342100:0:12972:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd24605b800): rc 0 00000020:00080000:3.0:1788796692.342104:0:12972:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9bd2466c8000) has no exports 00000020:00010000:3.0:1788796692.342115:0:5833:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9bd24605b800: total 1 00000020:00000080:1.0:1788796692.342138:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27ecc4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788796692.342140:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9bd24605b800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788796692.342170:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd24152e000/0xdd273c88cfe22683 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd273c88cfe2267c expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796692.342192:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d20400/0xdd273c88cfe226de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd273c88cfe226d7 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796692.342207:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd240030800/0xdd273c88cfe22659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd273c88cfe22652 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796692.342230:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd282052a00/0xdd273c88cfe22698 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd273c88cfe22691 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796692.342336:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d21800/0xdd273c88cfe22897 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd273c88cfe22890 expref: 5 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796692.342348:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd2821d5400/0xdd273c88cfe228a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd273c88cfe2289e expref: 4 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796692.342363:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd240031400/0xdd273c88cfe2245a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd273c88cfe22453 expref: 3 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796692.342375:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd24152f800/0xdd273c88cfe22667 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdd273c88cfe22660 expref: 2 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796692.342386:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9bd24605b800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788796692.342400:0:5833:0:(genops.c:885:class_export_put()) final put ffff9bd24605b800/7f7145a2-0840-45a5-acde-da959fc7802f 00010000:00010000:3.0:1788796692.342417:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796692.342420:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796692.342422:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796692.342472:0:5838:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9bd250572600:5838] 1 exiting: rc = 0 00000100:00100000:3.0:1788796692.342554:0:5839:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9bd250237800:5839] 2 exiting: rc = 0 00000100:00100000:3.0:1788796692.342606:0:5837:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9bd2502d0400:5837] 0 exiting: rc = 1 00000020:00000080:1.0:1788796692.342651:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd24605b800/7f7145a2-0840-45a5-acde-da959fc7802f for MGS 00000100:00100000:3.0:1788796692.342659:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342671:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342682:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788796692.342688:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd24605e800 for MGS 00000100:00100000:3.0:1788796692.342693:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342703:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342709:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342714:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342728:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342734:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342742:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342773:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342780:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342786:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342792:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342797:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342803:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342884:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342895:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342902:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342908:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342914:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342919:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342926:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342932:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342938:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342943:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342949:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342957:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342963:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342969:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342975:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342981:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342988:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.342994:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343000:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343006:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343013:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343018:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343027:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343035:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343043:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343049:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343062:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343068:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343074:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343079:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343084:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343090:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343096:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343101:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343108:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343114:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343122:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343133:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343141:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343150:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343158:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343167:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343176:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343183:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343192:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343200:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343208:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.343216:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788796692.348976:0:12972:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788796692.349097:0:12972:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788796692.350050:0:12972:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd1423eb000 - data ffff9bd267e60d80/ffff9bd27d0c2800 00000020:01000000:3.0:1788796692.350153:0:12972:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd24db03c00 - data ffff9bd24cf250d8/ffff9bd2466a5400 00000020:00000080:3.0:1788796692.350884:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22326 00000020:00000080:3.0:1788796692.350894:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd2794d6000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788796692.350917:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd2794d6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:3.0:1788796692.350957:0:12972:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd250afa000 from MGS, refs=2 00000020:01000004:3.0:1788796692.350961:0:12972:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd250afa000 2 00000020:01000004:3.0:1788796692.350964:0:12972:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd250afa000 from MGS 00000020:00000080:3.0:1788796692.350985:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788796692.350992:0:12972:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788796692.351005:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd2794d6800/MGS 00000020:00000080:3.0:1788796692.351007:0:12972:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd2794d6800/MGS for MGS 00000020:01000000:3.0:1788796692.351014:0:12972:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788796692.351069:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788796692.351074:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788796692.351080:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788796692.351087:0:12972:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9bd27cd7b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788796692.351093:0:12972:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9bd26caa4d28) has exports, disconnecting them 00000020:00080000:3.0:1788796692.351097:0:12972:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9bd27cd7b800), last request at 1788796461 00000020:00000080:3.0:1788796692.351102:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe223f1 00000020:00080000:3.0:1788796692.351112:0:12972:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd27cd7b800): rc 0 00000020:00000080:3.0:1788796692.351117:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd27cd7b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788796692.351131:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27cd7b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788796692.351941:0:12972:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788796692.351946:0:12972:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788796692.351950:0:12972:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788796692.351955:0:12972:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788796692.351981:0:12649:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd27cd7a000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788796692.363410:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788796692.363439:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788796692.363446:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd27acfb800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788796692.363451:0:12972:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27acfb800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788796692.363463:0:12972:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788796692.364015:0:12972:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd250afa000 1 00000020:00000080:2.0:1788796692.364023:0:12972:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22318 00000020:00000080:2.0:1788796692.364029:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd2794d0000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788796692.364052:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788796692.364057:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788796692.364062:0:12972:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788796692.364065:0:12972:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9bd26caa0000) has no exports 00000020:00000080:2.0:1788796692.367090:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd2794d0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:3.0:1788796692.405951:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788796692.405962:0:7649:0:(genops.c:885:class_export_put()) final put ffff9bd2503ad000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788796692.406142:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd2503ad000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788796692.406207:0:12649:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd2503a9800 for lustre-OST0001 00000020:00000080:3.0:1788796692.423645:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788796692.423660:0:12972:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788796692.423666:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd250af8000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788796692.423671:0:12972:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd250af8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788796692.423682:0:12972:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788796692.423830:0:12972:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd250afe800 00000020:01000000:3.0:1788796692.423855:0:12972:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788796692.423860:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788796692.423865:0:12972:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788796692.423870:0:12972:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9bd2460719b8) has no exports 00000100:00100000:0.0:1788796692.424635:0:5844:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9bd255c04c00:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1788796692.424638:0:10139:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9bd24da91c00:10139] 3 exiting: rc = 0 00000100:00100000:1.0:1788796692.424837:0:5845:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9bd249fb5400:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1788796692.424931:0:5846:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9bd2502c2a00:5846] 2 exiting: rc = 0 00000100:00100000:1.0:1788796692.425840:0:12481:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff9bd24da44400:12481] 4 exiting: rc = 0 00000100:00100000:3.0:1788796692.426803:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426816:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426822:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426832:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426841:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426847:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426853:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426859:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426865:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426870:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426876:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426883:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426888:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426894:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426900:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426907:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426913:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426919:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426924:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426930:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426937:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426943:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426950:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426955:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426961:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426966:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426972:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426978:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426984:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426989:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.426995:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427000:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427005:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427010:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427027:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427033:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427039:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427044:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427049:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427056:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427061:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427066:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427072:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427091:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427098:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427105:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427112:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427118:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427123:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427130:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427135:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427141:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427146:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427152:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427172:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427178:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427184:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427189:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427195:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427201:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427206:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427212:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427218:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.427223:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.441803:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9bd250d04600:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1788796692.441947:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9bd250d05000:5847] 0 exiting: rc = 1 00000100:00100000:2.0:1788796692.443382:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443395:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443404:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443412:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443420:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443428:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443435:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443443:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443452:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443461:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443469:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443476:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443485:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443706:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443716:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443724:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443731:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443737:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443909:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443937:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443942:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443948:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443954:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443960:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443966:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443972:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443977:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443983:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443989:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.443995:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444001:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444008:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444013:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444019:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444024:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444029:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444035:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444040:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444046:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444050:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444055:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444060:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444065:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444071:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444076:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444081:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444086:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444092:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444098:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444103:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444108:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444114:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444120:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444125:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444139:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444144:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444150:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444155:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444336:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444345:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444352:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444361:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444368:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796692.444376:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.445425:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9bd2505bda00:5850] 1 exiting: rc = 0 00000100:00100000:2.0:1788796692.445507:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9bd246719a00:5849] 0 exiting: rc = 1 00000100:00100000:1.0:1788796692.445906:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.445920:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.445932:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.445941:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.445949:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.445955:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.445972:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446028:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446039:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446048:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446059:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446067:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446076:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446086:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446119:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446129:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446136:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446145:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446154:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446357:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446367:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446375:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446384:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446391:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446402:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446411:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446441:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446449:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446459:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446468:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446476:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446483:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446570:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446578:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446585:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446591:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446596:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446602:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446623:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446683:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446693:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446712:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446722:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446730:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446738:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446851:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446865:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446874:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446884:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446890:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446915:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446923:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446930:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446935:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446941:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446946:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446952:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446958:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446965:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446971:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446976:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.446982:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.447004:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796692.447012:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796692.466184:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9bd246719000:5851] 0 exiting: rc = 1 00000100:00100000:2.0:1788796692.466351:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9bd246718600:5852] 1 exiting: rc = 0 00000100:00100000:0.0:1788796692.469426:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469437:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469444:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469453:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469464:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469477:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469621:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469647:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469658:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469669:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469679:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469691:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469703:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469714:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469725:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469736:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469765:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469772:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469780:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469790:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469801:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469812:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469823:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469833:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469844:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469854:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469865:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469875:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469885:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469896:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469907:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469918:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469929:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469940:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469952:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469964:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469975:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469987:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.469996:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470007:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470019:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470029:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470048:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470059:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470070:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470081:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470091:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470101:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470112:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470122:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470133:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470143:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470154:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470161:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470165:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470168:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470173:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470177:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470183:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470188:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470192:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470196:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470201:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470206:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.470891:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9bd250258800:5853] 0 exiting: rc = 1 00000100:00100000:2.0:1788796692.472363:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9bd250258c00:5854] 1 exiting: rc = 0 00000100:00100000:0.0:1788796692.473378:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473388:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473394:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473400:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473405:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473411:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473416:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473422:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473428:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473435:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473441:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473446:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473469:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473474:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473479:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473485:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473501:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473508:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473513:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473518:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473523:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473529:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473534:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473540:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473546:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473551:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473556:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473561:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473567:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473573:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473578:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473584:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473590:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473595:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473600:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473606:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473611:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473617:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473622:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473628:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473632:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473637:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473642:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473647:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473652:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473657:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473663:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473676:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473681:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473686:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473692:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473698:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473703:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473708:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473714:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473720:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473725:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473730:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473736:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473742:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473769:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473775:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473781:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.473786:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.474434:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9bd24663f000:5855] 0 exiting: rc = 1 00000100:00100000:2.0:1788796692.474672:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9bd24663e600:5856] 1 exiting: rc = 0 00000100:00100000:0.0:1788796692.475036:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475044:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475049:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475055:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475060:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475065:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475071:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475077:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475083:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475089:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475094:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475100:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475106:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475112:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475118:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475124:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475129:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475146:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475151:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475169:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475176:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475181:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475187:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475192:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475197:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475203:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475208:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475214:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475219:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475224:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475230:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475374:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475380:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475385:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475391:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475396:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475402:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475407:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475412:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475417:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475422:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475428:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475433:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475439:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475445:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475449:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475454:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475458:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475464:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475469:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475475:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475480:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475506:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475512:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475518:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475524:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475529:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475534:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475539:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475545:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475550:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475556:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475562:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.475568:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.476084:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9bd250258e00:5859] 2 exiting: rc = 0 00000100:00100000:2.0:1788796692.476521:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9bd24663ee00:5857] 0 exiting: rc = 1 00000100:00100000:3.0:1788796692.476808:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9bd250258400:5858] 1 exiting: rc = 0 00000100:00100000:0.0:1788796692.480797:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480808:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480847:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480855:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480861:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480867:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480873:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480878:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480883:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480888:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480894:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480900:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480905:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480911:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480916:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480923:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480930:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480936:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480942:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480948:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480954:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480959:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480980:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480986:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480992:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.480999:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481020:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481028:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481034:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481041:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481047:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481054:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481061:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481066:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481072:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481077:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481084:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481089:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481095:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481100:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481106:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481112:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481118:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481124:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481129:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481134:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481140:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481145:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481151:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481346:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481371:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481378:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481384:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481389:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481394:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481400:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481406:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481419:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481425:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481431:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481437:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481442:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481448:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796692.481455:0:12972:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788796692.490360:0:12972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788796692.490375:0:12972:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788796692.490381:0:12972:0:(genops.c:885:class_export_put()) final put ffff9bd24a692000/MDS_uuid 00000020:00000080:0.0:1788796692.490385:0:12972:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd24a692000/MDS_uuid for MDS 00000020:01000000:0.0:1788796692.490391:0:12972:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788796692.490603:0:12972:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788796692.825913:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796693.853838:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796694.878254:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788796695.399719:0:12649:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788796695.399726:0:12649:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788796695.399733:0:12649:0:(import.c:65:import_set_state_nolock()) ffff9bd26769f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788796695.399742:0:12649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 417 00000100:00080000:0.0:1788796695.399772:0:12649:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788796695.399784:0:12649:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bd26769f800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1788796695.399798:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788796695.399814:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959333504:0@lo:400:kworker.0 00000400:00000100:0.0:1788796695.400717:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875688959333504 offset 0 length 224: 4 00000100:00100000:0.0:1788796695.400849:0:12649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27e37bb80 x1875688959333632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788796695.403640:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875688959333632:0@lo:38:kworker.0 00000400:00000100:1.0:1788796695.403712:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875688959333632 offset 0 length 520: 4 00000100:00080000:0.0:1788796695.403965:0:12649:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788796695.403970:0:12649:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788796695.403982:0:12649:0:(import.c:65:import_set_state_nolock()) ffff9bd267179000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788796695.403987:0:12649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 417 00000100:00080000:0.0:1788796695.403992:0:12649:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788796695.404027:0:12649:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd267179000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1788796695.404258:0:12649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27e37a680 x1875688959333760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788796695.404968:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875688959333760:0@lo:38:kworker.0 00000400:00000100:1.0:1788796695.405020:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875688959333760 offset 0 length 520: 4 00010000:00010000:3.0:1788796695.900867:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788796696.058706:0:13125:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788796696.083003:0:13125:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788796696.083053:0:13125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22683 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796696.083076:0:13125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22683 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796696.083083:0:13125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe22683 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796696.083090:0:13125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe22683 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796696.083125:0:13125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788796696.083136:0:13125:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788796696.083180:0:13125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788796696.083198:0:13125:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd27e37bb80 x1875688959333632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788796710 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796696.083220:0:13125:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788796696.083226:0:13125:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788796696.083232:0:13125:0:(import.c:65:import_set_state_nolock()) ffff9bd26769f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788796696.083237:0:13125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788796696.083241:0:13125:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd27e37bb80 x1875688959333632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788796710 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796696.083261:0:13125:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788796696.083264:0:13125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:3.0:1788796696.083519:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796696.083527:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe22683 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796696.083535:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152e800 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:3.0:1788796696.083539:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe22683 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796696.083548:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd273c88cfe22683 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788796696.083555:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd273c88cfe22683 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796696.083561:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788796696.083564:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788796696.083566:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788796696.083603:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe22683 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796696.083609:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788796696.083641:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe22683 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796696.083648:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959333888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788796696.083649:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd24152e800/0xdd273c88cfe2267c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe22683 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796696.083661:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796696.083663:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796696.083664:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796696.083717:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796696.084071:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875688959333632:0@lo:38:kworker.0 00000100:00100000:3.0:1788796696.087646:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959333888 00000100:00100000:3.0:1788796696.087680:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959333888 00000100:00100000:3.0:1788796696.087734:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788796696.087742:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e378e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1875688959333888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788796696.087764:0:5831:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788796696 with bad export cookie 15935772364774712130 00010000:00010000:1.0:1788796696.090347:0:13125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22698 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796696.090401:0:13125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22698 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796696.090408:0:13125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe22698 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796696.090415:0:13125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe22698 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796696.090443:0:13125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788796696.090610:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796696.090617:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe22698 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796696.090625:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152e400 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796696.090636:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe22698 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796696.090645:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd273c88cfe22698 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796696.090657:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd273c88cfe22698 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796696.090663:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788796696.090665:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788796696.090709:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe22698 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796696.090716:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788796696.090784:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe22698 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796696.090803:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796696.090811:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796696.090813:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796696.090865:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959334016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788796696.090949:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796696.091092:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959334016 00000100:00100000:2.0:1788796696.091099:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959334016 00000100:00100000:2.0:1788796696.091130:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788796696.091138:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3304:x1875688959334016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788796696.091144:0:5829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788796696 with bad export cookie 15935772364774712130 00010000:00010000:1.0:1788796696.091149:0:13125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd24152e400/0xdd273c88cfe22691 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe22698 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796696.091173:0:13125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe228a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796696.091181:0:13125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe228a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796696.091187:0:13125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe228a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796696.091191:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3304:x1875688959334016:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (242us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788796696.091197:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788796696.091199:0:13125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe228a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796696.091212:0:13125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788796696.091216:0:13125:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1788796696.091219:0:13125:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000100:00080000:2.0:1788796696.091229:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788796696.091232:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bd24605a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788796696.091236:0:3304:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000004:1.0:1788796696.091244:0:13125:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788796696.091263:0:13125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788796696.091268:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788796696.091274:0:13125:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788796696.091279:0:13125:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9bd2673e0000) has no exports 00000020:00080000:1.0:1788796696.091310:0:13125:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9bd2673e0000) has no exports 00010000:00010000:0.0:1788796696.094570:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796696.094604:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe228a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796696.094622:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20a00 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:0.0:1788796696.094627:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe228a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796696.094652:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd273c88cfe228a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788796696.094659:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd273c88cfe228a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796696.094665:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788796696.094668:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788796696.094672:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:3.0:1788796696.101742:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e378e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1875688959333888:12345-0@lo:103:ldlm_bl.0 Request processed in 13163us (17188us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788796696.101780:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788796696.101837:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:01000000:1.0:1788796696.102326:0:13125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd2678f3de0 - data ffff9bd267d581b0/ffff9bd27eaf2000 00000020:01000000:1.0:1788796696.102698:0:13125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd27d5a41e0 - data ffff9bd25dc436c0/ffff9bd26727b400 00000100:00080000:2.0:1788796696.143024:0:3304:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.125@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788796696.143029:0:3304:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788796696.143038:0:3304:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd27e378a80 x1875688959333504/t0(0) o400->MGC192.168.201.125@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788796711 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796696.143053:0:3304:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd267999c00 x1875688959333888/t0(0) o103->MGC192.168.201.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788796712 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796696.143080:0:3304:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd27e379180 x1875688959334016/t0(0) o103->MGC192.168.201.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788796712 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788796696.143090:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788796696.143093:0:3304:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788796696.143094:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:1.0:1788796696.150634:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe228a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796696.150652:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796696.150683:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe228a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796696.150692:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd247d20a00/0xdd273c88cfe2289e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdd273c88cfe228a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796696.150713:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796696.150715:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796696.150718:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796696.151350:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7f7145a2-0840-45a5-acde-da959fc7802f:0:1875688959334144:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788796696.157039:0:3307:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9bd24605a800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788796696.157084:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959333504:0@lo:400:kworker.0 00000100:00100000:3.0:1788796696.157115:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7f7145a2-0840-45a5-acde-da959fc7802f:3307:1875688959333888:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788796696.166514:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bd24605a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788796696.166530:0:3304:0:(import.c:545:import_select_connection()) MGC192.168.201.125@tcp: connect to NID 0@lo last attempt 187 00000100:00080000:2.0:1788796696.166548:0:3304:0:(import.c:666:import_select_connection()) MGC192.168.201.125@tcp: import ffff9bd24605a800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1788796696.166807:0:3304:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27e378000 x1875688959334272/t0(0) o250->MGC192.168.201.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788796696.166882:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7f7145a2-0840-45a5-acde-da959fc7802f:3304:1875688959334016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788796696.167137:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7f7145a2-0840-45a5-acde-da959fc7802f:3303:1875688959334272:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1788796696.167185:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875688959334272 offset 0 length 520: 4 00100000:10000000:3.0:1788796696.184626:0:13125:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788796696.223701:0:13125:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22476 00000020:00000080:0.0:1788796696.223712:0:13125:0:(genops.c:885:class_export_put()) final put ffff9bd2630b2800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788796696.223736:0:13125:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd2467d7000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788796696.223740:0:13125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd2467d7000 2 00000020:00000080:2.0:1788796696.223783:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd2630b2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:0.0:1788796696.223788:0:13125:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd2467d7000 from lustre-OST0000 00000020:00000080:0.0:1788796696.223810:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788796696.223819:0:13125:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788796696.223823:0:13125:0:(genops.c:885:class_export_put()) final put ffff9bd2630b5000/lustre-OST0000_UUID 00000020:00000080:0.0:1788796696.223825:0:13125:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd2630b5000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788796696.223831:0:13125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788796696.223880:0:13125:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788796696.223885:0:13125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788796696.223890:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788796696.223894:0:13125:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788796696.223901:0:13125:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9bd267699000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788796696.223907:0:13125:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9bd267694d28) has exports, disconnecting them 00000020:00080000:0.0:1788796696.223912:0:13125:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9bd267699000), last request at 1788796479 00000020:00000080:0.0:1788796696.223916:0:13125:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe224a0 00000020:00080000:0.0:1788796696.223926:0:13125:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd267699000): rc 0 00000020:00000080:0.0:1788796696.223931:0:13125:0:(genops.c:885:class_export_put()) final put ffff9bd267699000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788796696.223988:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd267699000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788796696.245238:0:13125:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788796696.245256:0:13125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788796696.245260:0:13125:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788796696.245268:0:13125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788796696.245453:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788796696.245461:0:13125:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788796696.245468:0:13125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd2467d7000 1 00000020:00000080:1.0:1788796696.245475:0:13125:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22430 00000020:00000080:1.0:1788796696.245500:0:13125:0:(genops.c:885:class_export_put()) final put ffff9bd27ec76000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788796696.245506:0:13125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788796696.245510:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788796696.245515:0:13125:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788796696.245519:0:13125:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9bd246073370) has no exports 00000020:00000080:2.0:1788796696.250236:0:12649:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd26769f800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788796696.250265:0:12649:0:(genops.c:885:class_export_put()) final put ffff9bd27ce28800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788796696.250269:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27ce28800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788796696.250278:0:12649:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788796696.250344:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27ec76000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788796696.294237:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788796696.294310:0:13125:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788796696.294317:0:13125:0:(genops.c:885:class_export_put()) final put ffff9bd2467d4000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788796696.294321:0:13125:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd2467d4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788796696.294331:0:13125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788796696.294471:0:13125:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd2467d2000 00000020:02000400:2.0:1788796696.294513:0:13125:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788796696.923954:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796697.946096:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796698.971865:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788796699.092349:0:13276:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788796699.106146:0:13276:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788796699.106239:0:13276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22659 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796699.106256:0:13276:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22659 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796699.106264:0:13276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe22659 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796699.106272:0:13276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe22659 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796699.106308:0:13276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788796699.106312:0:13276:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788796699.106330:0:13276:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788796699.106339:0:13276:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd27e37a680 x1875688959333760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788796710 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796699.106355:0:13276:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788796699.106359:0:13276:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788796699.106364:0:13276:0:(import.c:65:import_set_state_nolock()) ffff9bd267179000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788796699.106368:0:13276:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788796699.106371:0:13276:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd27e37a680 x1875688959333760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788796710 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796699.106375:0:13276:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788796699.106377:0:13276:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:3.0:1788796699.106527:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796699.106533:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe22659 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796699.106539:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd24152ea00 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:3.0:1788796699.106542:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe22659 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796699.106547:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd273c88cfe22659 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788796699.106552:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd273c88cfe22659 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796699.106555:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788796699.106562:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788796699.106564:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788796699.106576:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd24605a800 00010000:00010000:3.0:1788796699.106578:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd273c88cfe22659 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796699.106583:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd24152ea00/0xdd273c88cfe22652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd273c88cfe22659 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796699.106591:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796699.106592:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796699.106593:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796699.106813:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875688959333760:0@lo:38:kworker.0 00010000:00010000:0.0:1788796699.110541:0:13276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22667 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796699.110557:0:13276:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22667 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796699.110562:0:13276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe22667 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796699.110566:0:13276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe22667 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796699.110585:0:13276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788796699.110596:0:13276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe22897 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796699.110615:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796699.110618:0:13276:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe22897 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796699.110622:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe22667 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796699.110625:0:13276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe22897 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796699.110630:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20e00 already unused, calling callback (ffffffffc1a59c20) 00010000:00010000:0.0:1788796699.110631:0:13276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdd273c88cfe22897 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796699.110634:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe22667 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796699.110642:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd273c88cfe22667 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796699.110650:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd273c88cfe22667 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796699.110651:0:13276:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788796699.110656:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788796699.110656:0:13276:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 10000000:01000000:1.0:1788796699.110658:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788796699.110660:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788796699.110671:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd24605a800 00010000:00010000:1.0:1788796699.110674:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd273c88cfe22667 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788796699.110676:0:13276:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788796699.110680:0:13276:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:1.0:1788796699.110681:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe22660 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd273c88cfe22667 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788796699.110685:0:13276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788796699.110690:0:13276:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788796699.110693:0:13276:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9bd2676919b8) has no exports 00010000:00010000:1.0:1788796699.110694:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796699.110714:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe22897 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788796699.110714:0:13276:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9bd2676919b8) has no exports 00010000:00010000:1.0:1788796699.110720:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334000 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:1.0:1788796699.110723:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdd273c88cfe22897 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796699.110729:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd273c88cfe22897 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796699.110735:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd273c88cfe22897 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796699.110740:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788796699.110742:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788796699.110762:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788796699.110768:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd24605a800 00010000:00010000:1.0:1788796699.110771:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd273c88cfe22897 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796699.110777:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe22890 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd273c88cfe22897 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796699.110790:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796699.110791:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796699.110793:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796699.112899:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788796699.118810:0:13276:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd2678f3ae0 - data ffff9bd267d58ca8/ffff9bd27eaf2c00 00000020:01000000:1.0:1788796699.118983:0:13276:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9bd27db94120 - data ffff9bd267ca95e8/ffff9bd250a50c00 00100000:10000000:1.0:1788796699.132992:0:13276:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788796699.158277:0:13276:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22541 00000020:00000080:2.0:1788796699.158288:0:13276:0:(genops.c:885:class_export_put()) final put ffff9bd2503aa800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788796699.158308:0:13276:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd26717e800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788796699.158312:0:13276:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd26717e800 2 00000020:01000004:2.0:1788796699.158326:0:13276:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bd26717e800 from lustre-OST0001 00000020:00000080:2.0:1788796699.158353:0:13276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788796699.158364:0:13276:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788796699.158368:0:13276:0:(genops.c:885:class_export_put()) final put ffff9bd267698000/lustre-OST0001_UUID 00000020:00000080:2.0:1788796699.158371:0:13276:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd267698000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788796699.158377:0:13276:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788796699.158673:0:13276:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 7f7145a2-0840-45a5-acde-da959fc7802f->MGS 00010000:00010000:2.0:1788796699.158689:0:13276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd24152f200/0xdd273c88cfe22453 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd273c88cfe2245a expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796699.158702:0:13276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd24152f200/0xdd273c88cfe22453 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd273c88cfe2245a expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796699.158709:0:13276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788796699.158712:0:13276:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788796699.158715:0:13276:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788796699.158729:0:13276:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd24605a800 00010000:00010000:2.0:1788796699.158734:0:13276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd24152f200/0xdd273c88cfe22453 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd273c88cfe2245a expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796699.158917:0:13276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe226d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdd273c88cfe226de expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796699.158926:0:13276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe226d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdd273c88cfe226de expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796699.158931:0:13276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788796699.158933:0:13276:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788796699.158935:0:13276:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788796699.158945:0:13276:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bd24605a800 00010000:00010000:2.0:1788796699.158948:0:13276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd240030c00/0xdd273c88cfe226d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdd273c88cfe226de expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788796699.158977:0:13276:0:(import.c:65:import_set_state_nolock()) ffff9bd24605a800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788796699.158981:0:13276:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788796699.158983:0:13276:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788796699.158984:0:13276:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788796699.158988:0:13276:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788796699.158999:0:13276:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bd27e378000 x1875688959334272/t0(0) o250->MGC192.168.201.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788796706 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788796699.159067:0:13276:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788796699.159070:0:13276:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:0.0:1788796699.159445:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd2503aa800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788796699.159632:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7f7145a2-0840-45a5-acde-da959fc7802f:3303:1875688959334272:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:2.0:1788796699.159668:0:13276:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788796699.159675:0:13276:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22334 00000020:00000080:2.0:1788796699.159680:0:13276:0:(genops.c:885:class_export_put()) final put ffff9bd24a691000/7f7145a2-0840-45a5-acde-da959fc7802f 00000020:01000000:2.0:1788796699.159686:0:13276:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.125@tcp (flags='') 00000020:00000080:2.0:1788796699.159690:0:13276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788796699.159694:0:13276:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.125@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788796699.159697:0:13276:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9bd26caa3370) has no exports 00000020:00000080:0.0:1788796699.159719:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd24a691000/7f7145a2-0840-45a5-acde-da959fc7802f for MGC192.168.201.125@tcp 10000000:01000000:1.0:1788796699.159733:0:5841:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788796699.159775:0:13276:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.125@tcp: client import never connected 00000100:00080000:2.0:1788796699.159778:0:13276:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788796699.159779:0:13276:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788796699.159781:0:13276:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788796699.159782:0:13276:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788796699.159824:0:12649:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd24605a800 for MGC192.168.201.125@tcp 00000020:00000080:2.0:1788796699.159828:0:13276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788796699.159833:0:13276:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.125@tcp (uuid 7f7145a2-0840-45a5-acde-da959fc7802f) 00000020:00000080:2.0:1788796699.159835:0:13276:0:(genops.c:885:class_export_put()) final put ffff9bd24605b000/7f7145a2-0840-45a5-acde-da959fc7802f 00000020:00000080:2.0:1788796699.159837:0:13276:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd24605b000/7f7145a2-0840-45a5-acde-da959fc7802f for MGC192.168.201.125@tcp 00000020:01000000:2.0:1788796699.159841:0:13276:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.125@tcp (7f7145a2-0840-45a5-acde-da959fc7802f) 00000020:01000000:2.0:1788796699.160018:0:13276:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788796699.160023:0:13276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788796699.160027:0:13276:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788796699.160031:0:13276:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9bd27ead1800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788796699.160097:0:13276:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9bd2673e3370) has exports, disconnecting them 00000020:00080000:2.0:1788796699.160102:0:13276:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9bd27ead1800), last request at 1788796500 00000020:00000080:2.0:1788796699.160106:0:13276:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe2256b 00000020:00080000:2.0:1788796699.160117:0:13276:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bd27ead1800): rc 0 00000020:00000080:2.0:1788796699.160121:0:13276:0:(genops.c:885:class_export_put()) final put ffff9bd27ead1800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788796699.160160:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27ead1800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788796699.164278:0:13276:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788796699.164287:0:13276:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788796699.164291:0:13276:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788796699.164298:0:13276:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788796699.164412:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1788796699.164545:0:12649:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9bd267179000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788796699.167306:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1788796699.167517:0:5827:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9bd249fb5a00:5827] 0 exiting: rc = 1 00000100:00100000:0.0:1788796699.167570:0:5828:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9bd249e2e200:5828] 1 exiting: rc = 0 00000100:00100000:1.0:1788796699.167907:0:8456:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9bd267381600:8456] 2 exiting: rc = 0 00000100:00100000:0.0:1788796699.169105:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.169369:0:5830:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9bd249e2e400:5830] 1 exiting: rc = 0 00000100:00100000:1.0:1788796699.169496:0:8457:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9bd267312a00:8457] 3 exiting: rc = 0 00000100:00100000:1.0:1788796699.169560:0:5831:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9bd249e2f600:5831] 2 exiting: rc = 0 00000100:00100000:0.0:1788796699.169886:0:5829:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9bd249e2fe00:5829] 0 exiting: rc = 1 00000100:00100000:1.0:1788796699.169978:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.169986:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.169992:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.169998:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170004:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170014:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170020:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170025:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170031:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170038:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170044:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170050:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170056:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170062:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170068:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170074:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170081:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170087:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170092:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170098:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170103:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170109:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170114:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170120:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170127:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170135:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170153:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170161:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170170:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170178:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170188:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170195:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170225:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170236:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170242:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170247:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170252:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170257:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170263:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170268:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170274:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170280:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170285:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170291:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170297:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170302:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170308:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170314:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170319:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170325:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170331:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170336:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170341:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170346:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170352:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170357:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170362:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170369:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170374:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170382:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170530:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170543:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170549:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.170555:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788796699.171346:0:13276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788796699.171356:0:13276:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788796699.171362:0:13276:0:(genops.c:885:class_export_put()) final put ffff9bd27e653000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788796699.171366:0:13276:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27e653000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788796699.171372:0:13276:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788796699.171416:0:13276:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd26717e800 1 00000020:00000080:1.0:1788796699.171422:0:13276:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdd273c88cfe22510 00000020:00000080:1.0:1788796699.171428:0:13276:0:(genops.c:885:class_export_put()) final put ffff9bd26717c000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788796699.171478:0:13276:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788796699.171483:0:13276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788796699.171488:0:13276:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788796699.171492:0:13276:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9bd27cfb8000) has no exports 00000020:00000080:0.0:1788796699.171820:0:12649:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd26717c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788796699.188309:0:13276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788796699.188322:0:13276:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788796699.188327:0:13276:0:(genops.c:885:class_export_put()) final put ffff9bd26717e000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788796699.188330:0:13276:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd26717e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788796699.188335:0:13276:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788796699.188481:0:13276:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bd26717c800 00000020:01000000:0.0:1788796699.188499:0:13276:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788796699.188502:0:13276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788796699.188505:0:13276:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788796699.188509:0:13276:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9bd26caa19b8) has no exports 00000020:00000080:0.0:1788796699.188529:0:13276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788796699.188533:0:13276:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788796699.188535:0:13276:0:(genops.c:885:class_export_put()) final put ffff9bd27ec74000/OSS_uuid 00000020:00000080:0.0:1788796699.188537:0:13276:0:(genops.c:844:class_export_destroy()) destroying export ffff9bd27ec74000/OSS_uuid for OSS 00000020:01000000:0.0:1788796699.188540:0:13276:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788796699.188769:0:5840:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788796699.188912:0:11435:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9bd27e218a00:11435] 3 exiting: rc = 0 00000100:00100000:3.0:1788796699.188979:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9bd2480aa400:6694] 2 exiting: rc = 0 00000100:00100000:3.0:1788796699.189135:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9bd2480ab000:6691] 0 exiting: rc = 1 00000100:00100000:2.0:1788796699.189275:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9bd250d0d600:6692] 1 exiting: rc = 0 00000100:00100000:0.0:1788796699.190535:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190553:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190570:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190580:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190585:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190591:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190596:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190601:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190606:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190611:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190616:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190621:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190625:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190630:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190636:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190653:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190658:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190665:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190672:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190678:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190684:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190692:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190700:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190708:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190716:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190723:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190733:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190742:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190773:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190781:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190789:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190800:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190808:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190815:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190822:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190829:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190836:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190843:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190851:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190856:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190861:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190867:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190872:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190878:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190882:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190891:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190897:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190902:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190906:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190911:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190921:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190926:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190931:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190935:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190940:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190944:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190949:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190953:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190957:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190961:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190965:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190971:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190976:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.190981:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.191812:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9bd2480ab400:6695] 0 exiting: rc = 1 00000100:00100000:3.0:1788796699.192352:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9bd2480aa200:6696] 1 exiting: rc = 0 00000100:00100000:0.0:1788796699.192684:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192697:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192703:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192709:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192715:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192720:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192725:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192732:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192738:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192761:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192906:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192918:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192923:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192928:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192933:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192940:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192945:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192950:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192955:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192961:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192975:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192981:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192986:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192992:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.192997:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193002:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193007:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193012:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193017:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193022:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193028:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193050:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193057:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193063:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193068:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193075:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193080:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193085:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193090:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193096:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193101:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193109:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193117:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193128:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193140:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193155:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193161:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193174:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193188:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193209:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193218:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193229:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193237:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193245:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193252:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193272:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193278:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193283:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193287:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193292:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193297:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193303:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193308:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.193313:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.194375:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9bd27cd2bc00:6699] 2 exiting: rc = 0 00000100:00100000:3.0:1788796699.194782:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9bd27cfa5e00:6698] 1 exiting: rc = 0 00000100:00100000:3.0:1788796699.194951:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9bd27cfa4200:6697] 0 exiting: rc = 1 00000100:00100000:3.0:1788796699.195189:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195208:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195218:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195227:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195235:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195243:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195252:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195261:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195271:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195278:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195283:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195288:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195301:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195317:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195323:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195328:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195334:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195339:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195345:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195350:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195356:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195362:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195369:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195374:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195380:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195387:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195394:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195400:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195407:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195414:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195419:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195425:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195432:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195439:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195444:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195451:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195472:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195479:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195485:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195490:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195496:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195502:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195509:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195515:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195521:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195528:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195536:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195542:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195556:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195562:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195568:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195575:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195580:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195586:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195593:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195598:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195603:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195609:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195614:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195619:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195628:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195634:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195639:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788796699.195645:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788796699.203330:0:6701:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9bd27cd2b200:6701] 1 exiting: rc = 0 00000100:00100000:1.0:1788796699.203511:0:6700:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9bd27cd2ac00:6700] 0 exiting: rc = 1 00000100:00100000:2.0:1788796699.203653:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203661:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203666:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203671:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203676:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203681:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203685:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203690:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203694:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203698:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203703:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203707:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203711:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203715:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203719:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203724:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203728:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203733:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203738:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203791:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203799:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203804:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203809:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203813:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203818:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203823:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203827:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203842:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203847:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203851:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203856:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203861:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203866:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203871:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203876:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203881:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203885:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203889:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203894:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203898:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203902:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203906:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203910:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203915:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203919:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203922:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203926:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203931:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203935:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203940:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203945:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203949:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203953:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203957:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203961:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203965:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203969:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203973:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203978:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203982:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203986:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.203990:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.204000:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.204005:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788796699.205621:0:6702:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9bd2725dd600:6702] 0 exiting: rc = 1 00000100:00100000:2.0:1788796699.205827:0:6703:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9bd2725ddc00:6703] 1 exiting: rc = 0 00000100:00100000:1.0:1788796699.205942:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.205961:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.205969:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.205974:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.205979:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.205985:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206008:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206015:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206021:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206027:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206034:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206106:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206115:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206122:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206128:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206134:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206140:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206242:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206265:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206284:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206291:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206297:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206304:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206309:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206325:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206331:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206338:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206343:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206349:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206355:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206375:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206383:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206390:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206564:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206570:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206575:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206580:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206585:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206593:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206599:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206605:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206611:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206630:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206637:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206642:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206649:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206654:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206660:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206665:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206671:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206677:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206682:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206695:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206701:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206718:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206725:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206730:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206737:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206743:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206812:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206817:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206823:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206830:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788796699.206836:0:13276:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788796699.215090:0:13276:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788796719.012217:0:13890:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788796729.940023:0:14351:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788796729.940030:0:14351:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788796729.940135:0:14351:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd27e170800 00000020:01000004:2.0:1788796729.940149:0:14351:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788796729.940157:0:14351:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788796729.940172:0:14351:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9bd2676919b8) 00000020:00000080:2.0:1788796729.940184:0:14351:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788796729.970172:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788796729.974201:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788796729.975227:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 535: rc = 0 00100000:10000000:2.0:1788796729.976003:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 535: rc = 0 00100000:10000000:2.0:1788796729.976116:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 535: rc = 0 00100000:10000000:2.0:1788796729.976306:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788796729.976380:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 535: rc = 0 00100000:10000000:2.0:1788796729.976493:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 535: rc = 0 00100000:10000000:2.0:1788796729.977181:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 535: rc = 0 00100000:10000000:2.0:1788796729.978128:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 537: rc = 0 00100000:10000000:2.0:1788796729.981020:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 673: rc = 0 00100000:10000000:2.0:1788796729.981154:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 673: rc = 0 00100000:10000000:3.0:1788796729.984036:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 308: rc = 0 00100000:10000000:3.0:1788796729.984379:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 308: rc = 0 00100000:10000000:3.0:1788796729.985423:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 308: rc = 0 00100000:10000000:3.0:1788796729.986136:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 308: rc = 0 00100000:10000000:3.0:1788796729.986422:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 308: rc = 0 00100000:10000000:3.0:1788796729.988201:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 308: rc = 0 00100000:10000000:3.0:1788796729.989090:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 308: rc = 0 00100000:10000000:3.0:1788796729.989840:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 308: rc = 0 00100000:10000000:3.0:1788796729.990407:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 308: rc = 0 00100000:10000000:3.0:1788796729.991179:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 308: rc = 0 00100000:10000000:3.0:1788796729.991649:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 308: rc = 0 00100000:10000000:3.0:1788796729.991972:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 308: rc = 0 00100000:10000000:3.0:1788796729.992412:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 782: rc = 0 00100000:10000000:3.0:1788796729.992681:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 782: rc = 0 00100000:10000000:3.0:1788796729.992969:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 782: rc = 0 00100000:10000000:3.0:1788796729.993234:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 782: rc = 0 00100000:10000000:3.0:1788796729.993494:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 782: rc = 0 00100000:10000000:3.0:1788796729.994920:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 782: rc = 0 00100000:10000000:3.0:1788796729.995173:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 782: rc = 0 00100000:10000000:3.0:1788796729.996112:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 782: rc = 0 00100000:10000000:3.0:1788796729.997126:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 782: rc = 0 00100000:10000000:3.0:1788796729.998261:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 782: rc = 0 00100000:10000000:3.0:1788796729.999144:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 782: rc = 0 00100000:10000000:3.0:1788796730.000092:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 782: rc = 0 00100000:10000000:3.0:1788796730.000742:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 782: rc = 0 00100000:10000000:3.0:1788796730.001154:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 782: rc = 0 00100000:10000000:3.0:1788796730.002679:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 782: rc = 0 00100000:10000000:3.0:1788796730.003444:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 782: rc = 0 00100000:10000000:3.0:1788796730.004164:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 782: rc = 0 00100000:10000000:3.0:1788796730.005006:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 782: rc = 0 00100000:10000000:3.0:1788796730.005545:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 782: rc = 0 00100000:10000000:3.0:1788796730.006227:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 782: rc = 0 00100000:10000000:3.0:1788796730.007222:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 782: rc = 0 00100000:10000000:3.0:1788796730.008534:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 782: rc = 0 00100000:10000000:3.0:1788796730.009218:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 782: rc = 0 00100000:10000000:3.0:1788796730.010282:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 782: rc = 0 00100000:10000000:3.0:1788796730.011130:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 782: rc = 0 00100000:10000000:3.0:1788796730.012015:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 782: rc = 0 00100000:10000000:3.0:1788796730.012276:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 782: rc = 0 00100000:10000000:3.0:1788796730.013137:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 782: rc = 0 00100000:10000000:3.0:1788796730.013827:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 782: rc = 0 00100000:10000000:2.0:1788796730.014446:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 782: rc = 0 00100000:10000000:2.0:1788796730.014736:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 782: rc = 0 00100000:10000000:2.0:1788796730.015015:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 782: rc = 0 00100000:10000000:2.0:1788796730.015357:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 321: rc = 0 00100000:10000000:2.0:1788796730.015924:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788796730.016087:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 771: rc = 0 00100000:10000000:2.0:1788796730.016306:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788796730.016378:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 771: rc = 0 00100000:10000000:2.0:1788796730.016569:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788796730.016635:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:2.0:1788796730.016995:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788796730.017058:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 674: rc = 0 00100000:10000000:2.0:1788796730.017251:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788796730.017308:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 674: rc = 0 00100000:10000000:2.0:1788796730.017474:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788796730.017531:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 674: rc = 0 00000020:00000080:2.0:1788796730.019233:0:14351:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788796730.019419:0:14351:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788796730.019495:0:14351:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd273c88cfe23627 00000020:01000004:2.0:1788796730.019678:0:14351:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788796730.019684:0:14351:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788796730.019690:0:14351:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd27e170800 from MGS 00000020:01000004:2.0:1788796730.019694:0:14351:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788796730.019707:0:14351:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9bd267694d28) 00000020:00000080:2.0:1788796730.019719:0:14351:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788796730.019986:0:14351:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd27e170800 from MGS, refs=2 00080000:01000000:2.0:1788796730.019993:0:14351:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788796730.019998:0:14351:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd273c88cfe23635 00000100:00100000:2.0:1788796730.020127:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788796730.020727:0:14351:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788796730.020736:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788796730.022080:0:14351:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788796730.022092:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788796730.023728:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788796730.024166:0:14351:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788796730.024172:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788796730.027115:0:14351:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788796730.027148:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788796730.028950:0:14351:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788796730.028964:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788796730.031125:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796730.031131:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796730.031134:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796730.031332:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796730.031334:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796730.031336:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796730.032817:0:14351:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788796730.038496:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788796730.054726:0:14351:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788796730.054959:0:14351:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788796730.054963:0:14351:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788796730.059202:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788796730.059528:0:14351:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788796730.060983:0:14351:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788796730.061538:0:14351:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788796730.065825:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788796730.066380:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788796730.066387:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788796730.068215:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788796730.068227:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788796730.069196:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788796730.069205:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1788796730.072472:0:14365:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788796730.074099:0:14351:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788796730.074125:0:14351:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.125@tcp' 00000020:01000004:0.0:1788796730.074126:0:14351:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788796730.074158:0:14351:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.125@tcp (typ=mgc) 00000020:00000080:0.0:1788796730.074170:0:14351:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.125@tcp (ffff9bd2673e0000) 00000020:00000080:0.0:1788796730.074186:0:14351:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788796730.074270:0:14351:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd2611e6800@MGC192.168.201.125@tcp: add connection 192.168.201.125@tcp at head 00010000:00010000:0.0:1788796730.074426:0:14351:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.125@tcp-0 is initialized 00000040:01000000:0.0:1788796730.074432:0:14351:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788796730.083017:0:14367:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788796730.083075:0:14351:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.125@tcp (uuid cc080b8f-c449-46a7-a564-69e1c33bc9a6) 00000020:00000080:1.0:1788796730.083102:0:14351:0:(genops.c:1384:class_connect()) connect: client cc080b8f-c449-46a7-a564-69e1c33bc9a6, cookie 0xdd273c88cfe23643 00000100:00080000:1.0:1788796730.083116:0:14351:0:(import.c:545:import_select_connection()) MGC192.168.201.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788796730.083131:0:14351:0:(import.c:666:import_select_connection()) MGC192.168.201.125@tcp: import ffff9bd2611e6800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1788796730.083168:0:14351:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27e3c9f80 x1875688959334400/t0(0) o250->MGC192.168.201.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788796730.083188:0:14351:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cc080b8f-c449-46a7-a564-69e1c33bc9a6->MGS 00000020:01000004:1.0:1788796730.083215:0:14351:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788796730.083220:0:14351:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788796730.083234:0:14351:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9bd246074d28) 00000020:00000080:1.0:1788796730.083254:0:14351:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788796730.095803:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3303:1875688959334400:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788796730.095895:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796730.103461:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959334400 00000100:00100000:2.0:1788796730.103480:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959334400 00000100:00100000:2.0:1788796730.104450:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788796730.104460:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2630c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1875688959334400:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788796730.104488:0:14362:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from cc080b8f-c449-46a7-a564-69e1c33bc9a6@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:2.0:1788796730.105384:0:14362:0:(genops.c:1384:class_connect()) connect: client cc080b8f-c449-46a7-a564-69e1c33bc9a6, cookie 0xdd273c88cfe23651 00000100:00080000:2.0:1788796730.106059:0:14362:0:(import.c:65:import_set_state_nolock()) ffff9bd2467d1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788796730.106160:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2630c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+5:3303:x1875688959334400:12345-0@lo:250:mount.lustre.0 Request processed in 1699us (10264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796730.106170:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796730.106424:0:3303:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788796730.106435:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.125@tcp: connect to target with instance 0 00000100:00080000:3.0:1788796730.106443:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788796730.106448:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788796730.106452:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd2611e6800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788796730.106454:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788796730.106470:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788796730.106476:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3303:1875688959334400:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788796730.129423:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788796730.130009:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788796730.130017:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788796730.131711:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788796730.131724:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788796730.133674:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788796730.133690:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788796730.135650:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788796730.136209:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788796730.136216:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788796730.137430:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788796730.137442:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788796730.211280:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788796730.213040:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788796730.213049:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788796730.216567:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788796730.216584:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788796730.222583:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788796730.222820:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788796730.222827:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788796730.225092:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788796730.225191:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788796730.226179:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788796730.228493:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788796730.228624:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788796730.230103:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788796730.230117:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788796730.231180:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788796730.231624:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788796730.231633:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788796730.232641:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788796730.232651:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788796730.270769:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788796730.271546:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788796730.271554:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788796730.285620:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788796730.285643:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788796730.288833:0:14351:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788796730.288860:0:14351:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788796730.299214:0:14351:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788796730.299257:0:14351:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788796730.299332:0:14351:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788796730.299484:0:14351:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788796730.300091:0:14351:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.125@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788796730.300097:0:14351:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788796730.300099:0:14351:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788796730.300100:0:14351:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796730.300102:0:14351:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796730.300103:0:14351:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796730.300105:0:14351:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796730.300106:0:14351:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788796730.300108:0:14351:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788796730.300110:0:14351:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796730.300111:0:14351:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788796730.300114:0:14351:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788796730.300117:0:14351:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788796730.300118:0:14351:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788796730.300119:0:14351:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796730.300120:0:14351:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796730.300121:0:14351:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796730.300122:0:14351:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796730.300123:0:14351:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788796730.300124:0:14351:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788796730.300125:0:14351:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796730.300126:0:14351:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788796730.300155:0:14351:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788796730.300177:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959334528:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788796730.300255:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796730.303449:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6900 going to sleep for 11 seconds 00000100:00100000:0.0:1788796730.304397:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959334528 00000100:00100000:0.0:1788796730.304410:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959334528 00000100:00100000:0.0:1788796730.304466:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796730.304474:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2630c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+5:14351:x1875688959334528:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788796730.304534:0:14364:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788796730.304537:0:14364:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788796730.304540:0:14364:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788796730.306370:0:14385:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788796730.306842:0:14364:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788796730.309683:0:14386:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788796730.309692:0:14386:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788796730.309695:0:14386:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788796730.309730:0:14386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788796730.310521:0:14364:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788796730.310532:0:14364:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788796730.334581:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2630c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+5:14351:x1875688959334528:12345-0@lo:253:mount.lustre.0 Request processed in 30096us (34315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796730.334598:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788796730.340402:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959334528:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788796730.340424:0:14351:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788796730.340427:0:14351:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788796730.340429:0:14351:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788796730.340430:0:14351:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788796730.340432:0:14351:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788796730.340433:0:14351:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788796730.340434:0:14351:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788796730.340435:0:14351:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788796730.340437:0:14351:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788796730.340438:0:14351:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788796730.340440:0:14351:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788796730.340460:0:14351:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd27e170800 from lustre-MDT0000 10000000:01000000:3.0:1788796730.340487:0:14351:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788796730.340489:0:14351:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788796730.340501:0:14351:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bd2673e0000 10000000:01000000:3.0:1788796730.340505:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788796730.340527:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9bd2673e0000 from 1 10000000:01000000:3.0:1788796730.340531:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788796730.340573:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d21800/0xdd273c88cfe23658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.340584:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd247d21800/0xdd273c88cfe23658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.340593:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd247d21800/0xdd273c88cfe23658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796730.340614:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959334656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788796730.340688:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796730.340729:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250968c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796730.342097:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959334656 00000100:00100000:2.0:1788796730.342110:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959334656 00000100:00100000:2.0:1788796730.342165:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788796730.342175:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2630c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+5:14351:x1875688959334656:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788796730.342190:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796730.342209:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2466b6200/0xdd273c88cfe2365f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe23658 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.342235:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2466b6200/0xdd273c88cfe2365f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe23658 expref: 6 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.342246:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2466b6200/0xdd273c88cfe2365f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe23658 expref: 6 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.342254:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6200, rc 0) 00000100:00100000:2.0:1788796730.342307:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2630c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+6:14351:x1875688959334656:12345-0@lo:101:mount.lustre.0 Request processed in 133us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796730.342314:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788796730.344440:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959334656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788796730.344469:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd247d21800/0xdd273c88cfe23658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2365f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.344482:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd247d21800/0xdd273c88cfe23658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe2365f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796730.344568:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959334784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788796730.344621:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796730.344672:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250968c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788796730.344728:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959334784 00000100:00100000:0.0:1788796730.344735:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959334784 00000100:00100000:0.0:1788796730.344810:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788796730.344818:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2630c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+6:14351:x1875688959334784:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788796730.345064:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2630c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+6:14351:x1875688959334784:12345-0@lo:501:mount.lustre.0 Request processed in 246us (442us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788796730.345080:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788796730.347219:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959334784:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788796730.347284:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788796730.347309:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d21800/0xdd273c88cfe23658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2365f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.347340:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd247d21800/0xdd273c88cfe23658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2365f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796730.347349:0:14351:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd27e170800 10000000:01000000:3.0:1788796730.347354:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788796730.347359:0:14351:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bd27e170800 10000000:01000000:3.0:1788796730.347363:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788796730.347367:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9bd27e170800 from 1 10000000:01000000:3.0:1788796730.347370:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788796730.347399:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20400/0xdd273c88cfe23666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.347407:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd247d20400/0xdd273c88cfe23666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.347418:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd247d20400/0xdd273c88cfe23666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796730.347435:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959334912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788796730.347482:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796730.347528:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250968c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796730.347644:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959334912 00000100:00100000:2.0:1788796730.347660:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959334912 00000100:00100000:2.0:1788796730.347709:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788796730.347717:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2630c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+6:14351:x1875688959334912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788796730.347729:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796730.347742:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2466b7000/0xdd273c88cfe2366d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe23666 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.347814:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2466b7000/0xdd273c88cfe2366d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe23666 expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.347825:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2466b7000/0xdd273c88cfe2366d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe23666 expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.347833:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7000, rc 0) 00000100:00100000:2.0:1788796730.347883:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2630c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+7:14351:x1875688959334912:12345-0@lo:101:mount.lustre.0 Request processed in 166us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796730.347889:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788796730.348268:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959334912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788796730.348283:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd247d20400/0xdd273c88cfe23666 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2366d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.348293:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd247d20400/0xdd273c88cfe23666 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe2366d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796730.348564:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788796730.348568:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20400/0xdd273c88cfe23666 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2366d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.348575:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd247d20400/0xdd273c88cfe23666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2366d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796730.348582:0:14351:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788796730.348586:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788796730.348591:0:14351:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bd27e170800 10000000:01000000:3.0:1788796730.348593:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788796730.348596:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788796730.348598:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788796730.348617:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d21600/0xdd273c88cfe23674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.348625:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd247d21600/0xdd273c88cfe23674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.348632:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd247d21600/0xdd273c88cfe23674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796730.348648:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959335040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788796730.348694:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796730.348726:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250968c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796730.348787:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959335040 00000100:00100000:3.0:1788796730.348801:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959335040 00000100:00100000:3.0:1788796730.348833:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788796730.352047:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2630c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+7:14351:x1875688959335040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788796730.352073:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796730.352102:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d20200/0xdd273c88cfe2367b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe23674 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.352135:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d20200/0xdd273c88cfe2367b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe23674 expref: 8 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.352146:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d20200/0xdd273c88cfe2367b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe23674 expref: 8 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.352155:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20200, rc 0) 00000100:00100000:3.0:1788796730.352238:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2630c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+8:14351:x1875688959335040:12345-0@lo:101:mount.lustre.0 Request processed in 3392us (3543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796730.352246:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788796730.352476:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267998a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959335040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788796730.352507:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd247d21600/0xdd273c88cfe23674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2367b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.352517:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd247d21600/0xdd273c88cfe23674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe2367b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796730.352591:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959335168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788796730.352623:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796730.352667:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788796730.352796:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959335168 00000100:00100000:0.0:1788796730.352802:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959335168 00000100:00100000:0.0:1788796730.352837:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788796730.352852:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2630c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+8:14351:x1875688959335168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788796730.353185:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2630c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+9:14351:x1875688959335168:12345-0@lo:501:mount.lustre.0 Request processed in 340us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796730.353192:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788796730.355005:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959335168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788796730.355062:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959335296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788796730.355117:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796730.355156:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788796730.356516:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959335296 00000100:00100000:0.0:1788796730.356529:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959335296 00000100:00100000:0.0:1788796730.356591:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788796730.356600:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+9:14351:x1875688959335296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788796730.362025:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+9:14351:x1875688959335296:12345-0@lo:503:mount.lustre.0 Request processed in 5416us (6897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796730.362041:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788796730.362868:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959335296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788796730.364194:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14387:1875688959335424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796730.364285:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796730.364336:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796730.364633:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959335424 00000100:00100000:0.0:1788796730.364641:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959335424 00000100:00100000:0.0:1788796730.364700:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788796730.364711:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+9:14387:x1875688959335424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796730.365079:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+9:14387:x1875688959335424:12345-0@lo:502:llog_process_th.0 Request processed in 370us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796730.365087:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788796730.365438:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14387:1875688959335424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788796730.365471:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796730.365482:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796730.365484:0:14387:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788796730.365489:0:14387:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788796730.365492:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788796730.365513:0:14387:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9bd27cfb99b8) 00000020:00000080:3.0:1788796730.365534:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788796730.365541:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788796730.365619:0:14387:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788796730.365632:0:14387:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd273c88cfe23689 00000020:00000080:3.0:1788796730.365919:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788796730.365923:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796730.365927:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796730.365936:0:14387:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788796730.365940:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796730.365943:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796730.365945:0:14387:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788796730.365948:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788796730.365956:0:14387:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9bd27cfbcd28) 00000020:00000080:3.0:1788796730.365966:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788796730.365969:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788796730.365971:0:14387:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788796730.365974:0:14387:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788796730.365980:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788796730.366025:0:14387:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd27e170800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788796730.366038:0:14387:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9bd27cfb8000) 00000020:00000080:3.0:1788796730.366046:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788796730.366103:0:14387:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788796730.366109:0:14387:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd273c88cfe2369e 00000020:00000080:3.0:1788796730.366196:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788796730.366202:0:14387:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788796730.366206:0:14387:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdd273c88cfe236a5 00080000:01000000:3.0:1788796730.366212:0:14387:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788796730.366215:0:14387:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd273c88cfe236ac 00010000:00010000:3.0:1788796730.483288:0:14387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788796730.484126:0:14387:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788796730.484347:0:14387:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788796730.485195:0:14387:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9bd27cfbb370) 00000020:00000080:3.0:1788796730.485216:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788796730.485297:0:14387:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788796730.485303:0:14387:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd273c88cfe236ba 00000020:00000080:2.0:1788796730.489059:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788796730.508982:0:14387:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdd273c88cfe236c1 00000020:00000080:1.0:1788796730.517412:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788796730.517425:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788796730.517436:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796730.517439:0:14387:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788796730.517445:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788796730.517451:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796730.517452:0:14387:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788796730.517457:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788796730.517511:0:14387:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788796730.517527:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788796730.517530:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796730.517531:0:14387:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788796730.517534:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788796730.517536:0:14387:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788796730.517538:0:14387:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788796730.517539:0:14387:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788796730.517541:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788796730.517543:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796730.517544:0:14387:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788796730.517546:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788796730.517549:0:14387:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788796730.517552:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796730.517554:0:14387:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788796730.517557:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788796730.517563:0:14387:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.125@tcp to nid 0x20000c0a8c97d (192.168.201.125@tcp) 00000020:01000000:1.0:1788796730.517587:0:14387:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788796730.517591:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788796730.517607:0:14387:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bd246073370) 00000020:00000080:1.0:1788796730.517622:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788796730.517626:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788796730.517724:0:14387:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788796730.517731:0:14387:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788796730.517760:0:14387:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd273c88cfe236cf 00010000:00080000:1.0:1788796730.517807:0:14387:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd2630b4000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:1.0:1788796730.518037:0:14387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788796730.518680:0:14387:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788796730.518726:0:14387:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788796730.522138:0:14387:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788796730.522215:0:14387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788796730.522309:0:14387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788796730.523169:0:14391:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788796730.523175:0:14391:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788796730.524061:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788796730.524072:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788796730.524103:0:14387:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788796730.524119:0:14387:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd273c88cfe236d6 00000100:00080000:3.0:1788796730.524135:0:14387:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788796730.524147:0:14387:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd2630b4000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:3.0:1788796730.524180:0:14387:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd267999c00 x1875688959335552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788796730.524205:0:14387:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788796730.524251:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1788796730.524445:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959335552:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788796730.524568:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875688959335552 offset 0 length 520: 4 00000020:00000080:3.0:1788796730.525094:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796730.525097:0:14387:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788796730.525104:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788796730.525107:0:14387:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788796730.525108:0:14387:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788796730.525110:0:14387:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788796730.525111:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788796730.525114:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796730.525115:0:14387:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788796730.525117:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788796730.525121:0:14387:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788796730.525124:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796730.525125:0:14387:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788796730.525127:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788796730.525131:0:14387:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.125@tcp to nid 0x20000c0a8c97d (192.168.201.125@tcp) 00000020:01000000:3.0:1788796730.525152:0:14387:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788796730.525154:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788796730.525167:0:14387:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bd2466c8000) 00000020:00000080:3.0:1788796730.525181:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788796730.525184:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788796730.525323:0:14387:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788796730.525330:0:14387:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788796730.525336:0:14387:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdd273c88cfe236e4 00010000:00080000:3.0:1788796730.525370:0:14387:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd27b4e5000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:3.0:1788796730.525634:0:14387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788796730.525942:0:14387:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788796730.525965:0:14387:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788796730.526929:0:14387:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788796730.526996:0:14387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788796730.527073:0:14387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788796730.527478:0:14393:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788796730.527483:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788796730.528363:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788796730.528378:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788796730.528413:0:14387:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788796730.528430:0:14387:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd273c88cfe236eb 00000100:00080000:1.0:1788796730.528441:0:14387:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788796730.528452:0:14387:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd27b4e5000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1788796730.528488:0:14387:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27e3c8000 x1875688959335680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788796730.528525:0:14387:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788796730.528581:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788796730.528585:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796730.528587:0:14387:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788796730.528590:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788796730.528594:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796730.528595:0:14387:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788796730.528598:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788796730.528600:0:14387:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788796730.528602:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788796730.528604:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796730.528606:0:14387:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788796730.528608:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788796730.528609:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788796730.528611:0:14387:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788796730.528614:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788796730.528660:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14387:1875688959335808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788796730.528729:0:14387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796730.528966:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249ef2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788796730.528995:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959335808 00000100:00100000:1.0:1788796730.529002:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959335808 00000100:00100000:1.0:1788796730.529039:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788796730.529046:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+9:14387:x1875688959335808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796730.529355:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959335680:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788796730.529383:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875688959335680 offset 0 length 520: 4 00000100:00100000:1.0:1788796730.529585:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+9:14387:x1875688959335808:12345-0@lo:502:llog_process_th.0 Request processed in 538us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796730.529593:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788796730.532394:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14387:1875688959335808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788796730.532437:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796730.532448:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796730.532450:0:14387:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788796730.532455:0:14387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788796730.532730:0:14351:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788796730.532943:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788796730.532999:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d21600/0xdd273c88cfe23674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2367b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.533012:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd247d21600/0xdd273c88cfe23674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2367b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796730.533020:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd27e170800 from 1 10000000:01000000:2.0:1788796730.533023:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788796730.533063:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7c00/0xdd273c88cfe236f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.533072:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7c00/0xdd273c88cfe236f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.533082:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7c00/0xdd273c88cfe236f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796730.533103:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959335936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788796730.533163:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796730.533214:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796730.533274:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959335936 00000100:00100000:3.0:1788796730.533282:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959335936 00000100:00100000:3.0:1788796730.533331:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788796730.533341:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+9:14351:x1875688959335936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788796730.533354:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796730.533367:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe236f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe236f2 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.533387:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe236f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe236f2 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.533397:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe236f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe236f2 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.533405:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20600, rc 0) 00000100:00100000:3.0:1788796730.533440:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+10:14351:x1875688959335936:12345-0@lo:101:mount.lustre.0 Request processed in 101us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796730.533460:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788796730.533601:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959335936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788796730.533614:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7c00/0xdd273c88cfe236f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe236f9 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.533628:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7c00/0xdd273c88cfe236f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe236f9 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796730.534205:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959336064:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788796730.534245:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796730.534269:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788796730.534461:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959336064 00000100:00100000:1.0:1788796730.534467:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959336064 00000100:00100000:1.0:1788796730.534513:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788796730.534522:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+10:14351:x1875688959336064:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788796730.534538:0:14364:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788796730.534544:0:14364:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788796730.534610:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+10:14351:x1875688959336064:12345-0@lo:256:mount.lustre.0 Request processed in 89us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796730.534617:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788796730.534874:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959336064:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788796730.535467:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788796730.535729:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7c00/0xdd273c88cfe236f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe236f9 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.535742:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7c00/0xdd273c88cfe236f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe236f9 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796730.535789:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd27e170800 from 1 10000000:01000000:2.0:1788796730.535792:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788796730.535826:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7200/0xdd273c88cfe23700 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.535834:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7200/0xdd273c88cfe23700 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.535843:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7200/0xdd273c88cfe23700 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796730.535860:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959336192:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788796730.535903:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796730.535951:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796730.536213:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959336192 00000100:00100000:3.0:1788796730.536222:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959336192 00000100:00100000:3.0:1788796730.536266:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788796730.536275:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+10:14351:x1875688959336192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788796730.536287:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796730.536301:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d20000/0xdd273c88cfe23707 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe23700 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.536320:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d20000/0xdd273c88cfe23707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe23700 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.536331:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d20000/0xdd273c88cfe23707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe23700 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.536339:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20000, rc 0) 00000100:00100000:3.0:1788796730.536379:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:14351:x1875688959336192:12345-0@lo:101:mount.lustre.0 Request processed in 105us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796730.536386:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788796730.536458:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959336192:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788796730.536471:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7200/0xdd273c88cfe23700 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23707 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.536480:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7200/0xdd273c88cfe23700 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe23707 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796730.536544:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959336320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788796730.536571:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796730.536597:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788796730.536713:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959336320 00000100:00100000:1.0:1788796730.536719:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959336320 00000100:00100000:1.0:1788796730.536781:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788796730.536788:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:14351:x1875688959336320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788796730.537186:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:14351:x1875688959336320:12345-0@lo:501:mount.lustre.0 Request processed in 397us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796730.537192:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788796730.537346:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959336320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788796730.537373:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959336448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788796730.537406:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796730.537434:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796730.537506:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959336448 00000100:00100000:3.0:1788796730.537511:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959336448 00000100:00100000:3.0:1788796730.537540:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788796730.537547:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:14351:x1875688959336448:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788796730.537694:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:14351:x1875688959336448:12345-0@lo:503:mount.lustre.0 Request processed in 146us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796730.537700:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788796730.538018:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959336448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788796730.538402:0:14395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14395:1875688959336576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796730.538443:0:14395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796730.538477:0:14395:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27d7a6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788796730.538581:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959336576 00000100:00100000:3.0:1788796730.538592:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959336576 00000100:00100000:3.0:1788796730.538630:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788796730.538638:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:14395:x1875688959336576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796730.539237:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:14395:x1875688959336576:12345-0@lo:502:llog_process_th.0 Request processed in 597us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796730.539245:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788796730.539328:0:14395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14395:1875688959336576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788796730.539354:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796730.539363:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796730.539365:0:14395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788796730.539373:0:14395:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd27e170800 00000020:00000080:2.0:1788796730.539376:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788796730.539383:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796730.539390:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796730.539392:0:14395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788796730.539394:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796730.539397:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796730.539398:0:14395:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788796730.539401:0:14395:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd27e170800 00000020:00000080:2.0:1788796730.539403:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788796730.539462:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796730.539465:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796730.539467:0:14395:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788796730.539469:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796730.539471:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796730.539473:0:14395:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788796730.539476:0:14395:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd27e170800 00000020:00000080:2.0:1788796730.539478:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788796730.540636:0:14395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14395:1875688959336704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796730.540714:0:14395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796730.540769:0:14395:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249ac0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788796730.540977:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959336704 00000100:00100000:3.0:1788796730.540986:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959336704 00000100:00100000:3.0:1788796730.541041:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788796730.541050:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:14395:x1875688959336704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788796730.541262:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:14395:x1875688959336704:12345-0@lo:502:llog_process_th.0 Request processed in 212us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796730.541271:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788796730.541366:0:14395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14395:1875688959336704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788796730.541395:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796730.541404:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796730.541406:0:14395:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788796730.541410:0:14395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788796730.541964:0:14351:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788796730.541989:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788796730.542219:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7200/0xdd273c88cfe23700 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23707 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.542231:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7200/0xdd273c88cfe23700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23707 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796730.542279:0:14351:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788796730.542282:0:14351:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd27e170800 10000000:01000000:3.0:1788796730.542998:0:14351:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd27e170800 10000000:01000000:3.0:1788796730.543005:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788796730.543013:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd27e170800 from 1 10000000:01000000:3.0:1788796730.543017:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788796730.543067:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe2370e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.543085:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe2370e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796730.543096:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe2370e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796730.543123:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267998380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959336832:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788796730.543188:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796730.543225:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2459b9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796730.543299:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959336832 00000100:00100000:2.0:1788796730.543307:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959336832 00000100:00100000:2.0:1788796730.543362:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788796730.543371:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:14351:x1875688959336832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788796730.543384:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796730.543397:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2466b6000/0xdd273c88cfe23715 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2370e expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.543434:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2466b6000/0xdd273c88cfe23715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2370e expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.543444:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2466b6000/0xdd273c88cfe23715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2370e expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.543453:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6000, rc 0) 00000100:00100000:2.0:1788796730.543972:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14351:x1875688959336832:12345-0@lo:101:mount.lustre.0 Request processed in 599us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796730.543980:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788796730.544088:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267998380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959336832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788796730.544104:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe2370e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23715 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796730.544113:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe2370e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe23715 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796730.544626:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e379500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959336960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788796730.544677:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796730.544712:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250283c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796730.544805:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959336960 00000100:00100000:3.0:1788796730.544812:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959336960 00000100:00100000:3.0:1788796730.544849:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788796730.544857:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14351:x1875688959336960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788796730.545129:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14351:x1875688959336960:12345-0@lo:501:mount.lustre.0 Request processed in 271us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796730.545136:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788796730.545804:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e379500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959336960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788796730.545858:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e379500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959337088:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788796730.545900:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796730.545930:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250283c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796730.546027:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959337088 00000100:00100000:2.0:1788796730.546033:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959337088 00000100:00100000:2.0:1788796730.546071:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788796730.546079:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14351:x1875688959337088:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788796730.546246:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14351:x1875688959337088:12345-0@lo:503:mount.lustre.0 Request processed in 168us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796730.546254:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788796730.546296:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e379500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959337088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788796730.546469:0:14397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14397:1875688959337216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796730.550871:0:14397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796730.550921:0:14397:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249ac0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788796730.551081:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959337216 00000100:00100000:0.0:1788796730.551091:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959337216 00000100:00100000:0.0:1788796730.551146:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788796730.551156:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14397:x1875688959337216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788796730.551421:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14397:x1875688959337216:12345-0@lo:502:llog_process_th.0 Request processed in 265us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796730.551430:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788796730.554504:0:14397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14397:1875688959337216:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788796730.554591:0:14397:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788796730.554609:0:14397:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9bd267690000) 00000020:00000080:2.0:1788796730.554629:0:14397:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788796730.554741:0:14397:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd27e170800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788796730.554776:0:14397:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd27e170800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788796730.554779:0:14397:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd27e170800 4 00010000:00080000:2.0:1788796730.554807:0:14397:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd27acfc800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:2.0:1788796730.563063:0:14397:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788796730.563277:0:14397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788796730.563320:0:14397:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788796730.563335:0:14397:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdd273c88cfe23723 00000100:00080000:2.0:1788796730.563347:0:14397:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788796730.563359:0:14397:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bd27acfc800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1788796730.563397:0:14397:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27b4f8380 x1875688959337344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788796730.563435:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875688959337344:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788796730.569781:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788796730.569881:0:14397:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788796730.571709:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959337344 00000100:00100000:3.0:1788796730.571727:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959337344 00000100:00100000:3.0:1788796730.571808:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788796730.571816:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875688959337344:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788796730.571915:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875688959337344:12345-0@lo:38:llog_process_th.0 Request processed in 99us (2143us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788796730.571922:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788796730.578792:0:14397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14397:1875688959337472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796730.578881:0:14397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796730.578929:0:14397:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249ac06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796730.578971:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788796730.578979:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd27acfc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788796730.578983:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788796730.578986:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875688959337344:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788796730.579010:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959337472 00000100:00100000:2.0:1788796730.579016:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959337472 00000100:00100000:2.0:1788796730.579057:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788796730.579066:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14397:x1875688959337472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788796730.579334:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14397:x1875688959337472:12345-0@lo:502:llog_process_th.0 Request processed in 268us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796730.579342:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788796730.579390:0:14397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14397:1875688959337472:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788796730.579412:0:14397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788796730.579550:0:14351:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788796730.579578:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788796730.579595:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe2370e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23715 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.579607:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd247d20e00/0xdd273c88cfe2370e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23715 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788796730.579667:0:14351:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788796730.579669:0:14351:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788796730.579671:0:14351:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796730.579672:0:14351:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796730.579673:0:14351:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796730.579675:0:14351:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796730.579676:0:14351:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788796730.579678:0:14351:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788796730.579680:0:14351:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796730.579682:0:14351:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788796730.579686:0:14351:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788796730.579689:0:14351:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788796730.579690:0:14351:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788796730.579691:0:14351:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796730.579692:0:14351:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796730.579693:0:14351:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796730.579694:0:14351:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796730.579695:0:14351:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788796730.579697:0:14351:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788796730.579698:0:14351:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796730.579704:0:14351:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788796730.579720:0:14351:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788796730.579731:0:14351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959337600:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788796730.579797:0:14351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796730.579813:0:14351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249ac06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796730.579835:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959337600 00000100:00100000:2.0:1788796730.579840:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959337600 00000100:00100000:2.0:1788796730.579863:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788796730.579869:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14351:x1875688959337600:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788796730.579888:0:14364:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788796730.579900:0:14364:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788796730.699096:0:14364:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788796730.699111:0:14364:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788796730.703032:0:14385:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788796730.703062:0:14385:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788796730.703090:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe2372a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796730.703112:0:14385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe236f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe236f2 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796730.703121:0:14385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe2372a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796730.703167:0:14385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe236f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe236f2 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796730.703186:0:14385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe236f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe236f2 expref: 12 pid: 14362 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796730.703202:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e379180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14385:1875688959337728:0@lo:104: 00000100:00100000:0.0:1788796730.703275:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796730.703344:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250283e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788796730.704235:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959337728 00000100:00100000:2.0:1788796730.704245:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959337728 00000100:00100000:2.0:1788796730.704294:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788796730.704304:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+3:14385:x1875688959337728:12345-0@lo:104: 00010000:00010000:2.0:1788796730.704319:0:14352:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7c00/0xdd273c88cfe236f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe236f9 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.704390:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788796730.704396:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+3:14385:x1875688959337728:12345-0@lo:104: Request processed in 94us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796730.704402:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788796730.704425:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796730.704431:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7c00/0xdd273c88cfe236f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe236f9 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.704438:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7c00 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:2.0:1788796730.704442:0:14358:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7c00/0xdd273c88cfe236f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe236f9 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.704460:0:14358:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7c00/0xdd273c88cfe236f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe236f9 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796730.704468:0:14358:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7c00/0xdd273c88cfe236f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe236f9 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796730.704473:0:14358:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788796730.704518:0:14358:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7c00/0xdd273c88cfe236f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe236f9 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.704525:0:14358:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796730.704547:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7c00/0xdd273c88cfe236f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe236f9 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.704555:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7c00/0xdd273c88cfe236f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe236f9 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.704572:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796730.704573:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796730.704575:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796730.704606:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3306:1875688959337856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796730.704639:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796730.704719:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959337856 00000100:00100000:2.0:1788796730.704724:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959337856 00010000:00010000:2.0:1788796730.704741:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe236f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe236f2 expref: 13 pid: 14362 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796730.704978:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788796730.704987:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+13:3306:x1875688959337856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788796730.705015:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796730.705022:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe236f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe236f2 expref: 13 pid: 14362 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.705034:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe236f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe236f2 expref: 13 pid: 14362 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.705052:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe2372a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.705060:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe2372a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788796730.705076:0:14354:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002014019s 00010000:00010000:2.0:1788796730.705081:0:14354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe2372a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.705088:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe2372a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.705095:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe2372a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.705102:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe2372a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.705108:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4200 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796730.705112:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe2372a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.705120:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe2372a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.705137:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe2372a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796730.705146:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796730.705181:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+13:3306:x1875688959337856:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796730.705188:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788796730.705317:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3306:1875688959337856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788796730.705568:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d20600/0xdd273c88cfe236f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe236f2 expref: 12 pid: 14362 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796730.705582:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e379180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14385:1875688959337728:0@lo:104: 00010000:00010000:0.0:1788796730.705597:0:14385:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe2372a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796730.705606:0:14385:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe2372a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796730.705612:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe2372a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796730.705630:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe2372a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796730.716464:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:14351:x1875688959337600:12345-0@lo:253:mount.lustre.0 Request processed in 136585us (136657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796730.716479:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788796730.716668:0:14351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14351:1875688959337600:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788796730.716685:0:14351:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788796730.716688:0:14351:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788796730.716690:0:14351:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788796730.716692:0:14351:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796730.716693:0:14351:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796730.716694:0:14351:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796730.716695:0:14351:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796730.716697:0:14351:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788796730.716698:0:14351:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788796730.716700:0:14351:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796730.716701:0:14351:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788796730.716715:0:14351:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788796730.729450:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796730.729723:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788796730.730179:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796730.730323:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788796730.731182:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796730.731341:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788796730.740005:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788796730.740177:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788796730.740466:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788796730.740733:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788796730.741048:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788796730.741204:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788796730.857925:0:14351:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788796730.860061:0:14351:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788796730.860348:0:14407:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788796730.860353:0:14407:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788796730.860520:0:14408:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788796730.860623:0:14408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788796730.866743:0:14408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788796730.867421:0:14408:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788796730.867426:0:14408:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788796730.869669:0:14351:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788796730.869956:0:14351:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788796730.870365:0:14351:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788796730.870373:0:14351:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788796730.870511:0:14351:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788796730.872043:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788796730.872615:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788796730.872660:0:14351:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788796730.875419:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788796730.882095:0:14351:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788796731.017417:0:14351:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788796731.017461:0:14351:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4d041c5b988 00100000:10000000:1.0:1788796731.017470:0:14351:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788796731.018668:0:14351:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788796731.018684:0:14351:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788796731.018699:0:14351:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788796731.018728:0:14351:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788796731.098244:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788796731.613089:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788796731.803899:0:14367:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788796731.803908:0:14367:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd27e170800 from 6 10000000:01000000:0.0:1788796731.803912:0:14367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788796731.803965:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5200/0xdd273c88cfe23731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796731.803978:0:14367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5200/0xdd273c88cfe23731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796731.803990:0:14367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5200/0xdd273c88cfe23731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796731.804017:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e379180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959337984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788796731.804094:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796731.804153:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14300 going to sleep for 11 seconds 00000100:00100000:3.0:1788796731.804283:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959337984 00000100:00100000:3.0:1788796731.804292:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959337984 00000100:00100000:3.0:1788796731.804354:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788796731.804365:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:14367:x1875688959337984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796731.804383:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796731.804399:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d20a00/0xdd273c88cfe23738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe23731 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796731.804427:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d20a00/0xdd273c88cfe23738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe23731 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796731.804439:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d20a00/0xdd273c88cfe23738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe23731 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796731.804450:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20a00, rc 0) 00000100:00100000:3.0:1788796731.804496:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14367:x1875688959337984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796731.804503:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788796731.806013:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e379180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959337984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788796731.806041:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5200/0xdd273c88cfe23731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23738 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796731.806052:0:14367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5200/0xdd273c88cfe23731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe23738 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796731.806119:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e379180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959338112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788796731.806168:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796731.806213:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14300 going to sleep for 11 seconds 00000100:00100000:1.0:1788796731.806339:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959338112 00000100:00100000:1.0:1788796731.806345:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959338112 00000100:00100000:1.0:1788796731.806396:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788796731.806406:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14367:x1875688959338112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788796731.806426:0:14364:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788796731.806444:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788796731.806447:0:14364:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788796731.806556:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14367:x1875688959338112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796731.806563:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788796731.806986:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e379180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959338112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788796731.807031:0:14367:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788796731.807039:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5200/0xdd273c88cfe23731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23738 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796731.807048:0:14367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5200/0xdd273c88cfe23731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23738 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796732.122010:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788796732.634588:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788796733.147724:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796734.172168:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796735.200427:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788796735.838539:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788796735.838548:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788796735.838551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788796735.838565:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788796735.838567:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788796735.838571:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788796735.838575:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd27acfc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788796735.838594:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bd27acfc800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1788796735.838618:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27e37aa00 x1875688959338368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788796735.838650:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3307:1875688959338240:0@lo:400:kworker.0 00000100:00100000:0.0:1788796735.838724:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796735.838821:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959338240 00000100:00100000:0.0:1788796735.838829:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959338240 00000100:00100000:0.0:1788796735.838877:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788796735.838901:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:3307:x1875688959338240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796735.838955:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:3307:x1875688959338240:12345-0@lo:400:kworker.0 Request processed in 55us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796735.838963:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788796735.839011:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3307:1875688959338240:0@lo:400:kworker.0 00000100:00100000:3.0:1788796735.839507:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875688959338368:0@lo:38:kworker.0 00000100:00100000:3.0:1788796735.839546:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796735.840779:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959338368 00000100:00100000:0.0:1788796735.840790:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959338368 00000100:00100000:0.0:1788796735.840819:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796735.840826:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875688959338368:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788796735.840855:0:14371:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:0.0:1788796735.840891:0:14371:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdd273c88cfe2373f 00000004:00100000:0.0:1788796735.840906:0:14371:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788796735.841040:0:14371:0:(import.c:65:import_set_state_nolock()) ffff9bd246069000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788796735.841135:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875688959338368:12345-0@lo:38:kworker.0 Request processed in 307us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796735.841142:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788796735.841190:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd27e37aa00 x1875688959338368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788796745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788796735.841205:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788796735.841212:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788796735.841217:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788796735.841219:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd27acfc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788796735.841224:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875688959338368:0@lo:38:kworker.0 00010000:00010000:0.0:1788796736.239284:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788796736.830397:0:14651:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788796737.241928:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796738.266197:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796739.291015:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788796739.901583:0:14801:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc24cb040 20000000:00000080:1.0:1788796739.901602:0:14801:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd262798800 uarg=0000000000000000 20000000:01000000:1.0:1788796739.901635:0:14801:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788796739.901643:0:14801:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788796739.901649:0:14801:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788796739.902563:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788796739.902714:0:14801:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788796739.909497:0:14801:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788796739.909535:0:14801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd2466b6c00/0xdd273c88cfe23746 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796739.909556:0:14801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd247d20000/0xdd273c88cfe23707 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe23700 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796739.909566:0:14801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd2466b6c00/0xdd273c88cfe23746 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796739.909610:0:14801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd247d20000/0xdd273c88cfe23707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe23700 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796739.909626:0:14801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd247d20000/0xdd273c88cfe23707 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe23700 expref: 11 pid: 14363 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796739.909640:0:14801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14801:1875688959338496:0@lo:104: 00000100:00100000:2.0:1788796739.909705:0:14801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796739.909874:0:14801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2466e1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788796739.910079:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959338496 00000100:00100000:3.0:1788796739.910089:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959338496 00000100:00100000:3.0:1788796739.910144:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788796739.910153:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+3:14801:x1875688959338496:12345-0@lo:104: 00010000:00010000:3.0:1788796739.910166:0:14353:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7200/0xdd273c88cfe23700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe23707 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796739.910229:0:14353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788796739.910235:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+3:14801:x1875688959338496:12345-0@lo:104: Request processed in 84us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796739.910242:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788796739.910261:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796739.910267:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7200/0xdd273c88cfe23700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe23707 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796739.910275:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7200 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:3.0:1788796739.910279:0:14358:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7200/0xdd273c88cfe23700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe23707 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796739.910287:0:14358:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7200/0xdd273c88cfe23700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe23707 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788796739.910295:0:14358:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7200/0xdd273c88cfe23700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe23707 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796739.910300:0:14358:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788796739.910337:0:14358:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7200/0xdd273c88cfe23700 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe23707 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796739.910361:0:14358:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788796739.910382:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7200/0xdd273c88cfe23700 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe23707 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796739.910389:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7200/0xdd273c88cfe23700 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe23707 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796739.910405:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796739.910406:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796739.910408:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796739.910596:0:14801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14801:1875688959338496:0@lo:104: 00010000:00010000:1.0:1788796739.910616:0:14801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd2466b6c00/0xdd273c88cfe23746 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796739.910816:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3304:1875688959338624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796739.910847:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796739.910924:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959338624 00000100:00100000:1.0:1788796739.910929:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959338624 00010000:00010000:1.0:1788796739.910951:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd247d20000/0xdd273c88cfe23707 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe23700 expref: 12 pid: 14363 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796739.910980:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788796739.910987:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:3304:x1875688959338624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788796739.910998:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796739.911003:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd247d20000/0xdd273c88cfe23707 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe23700 expref: 12 pid: 14363 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796739.911014:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd247d20000/0xdd273c88cfe23707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe23700 expref: 12 pid: 14363 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796739.911027:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d20000/0xdd273c88cfe23707 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe23700 expref: 12 pid: 14363 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796739.911042:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd2466b6c00/0xdd273c88cfe23746 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796739.911050:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2466b6c00/0xdd273c88cfe23746 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796739.911072:0:14354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd2466b6c00/0xdd273c88cfe23746 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796739.911080:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd2466b6c00/0xdd273c88cfe23746 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796739.911086:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd2466b6c00/0xdd273c88cfe23746 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796739.911094:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd2466b6c00/0xdd273c88cfe23746 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796739.911100:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6c00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:1.0:1788796739.911103:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd2466b6c00/0xdd273c88cfe23746 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796739.911111:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd2466b6c00/0xdd273c88cfe23746 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796739.911126:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd2466b6c00/0xdd273c88cfe23746 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796739.911135:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796739.911166:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:3304:x1875688959338624:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796739.911172:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788796739.911231:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3304:1875688959338624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788796739.911306:0:14801:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd2466b6c00/0xdd273c88cfe23746 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796739.911314:0:14801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd2466b6c00/0xdd273c88cfe23746 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796739.911320:0:14801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd2466b6c00/0xdd273c88cfe23746 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796740.319611:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796740.954817:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788796730/real 1788796730] req@ffff9bd27e3c8000 x1875688959335680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788796740 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796740.954853:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd27e3c8000 x1875688959335680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788796740 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796740.954876:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788796730/real 1788796730] req@ffff9bd267999c00 x1875688959335552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788796740 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788796740.954891:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd267999c00 x1875688959335552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788796740 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788796740.954927:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd27b4e5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788796740.954944:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788796740.954948:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959335680:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788796740.954954:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd2630b4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788796740.954959:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788796740.954962:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959335552:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788796740.955285:0:12649:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788796740.955290:0:12649:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788796740.955293:0:12649:0:(import.c:65:import_set_state_nolock()) ffff9bd2630b4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788796740.955298:0:12649:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 457 00000100:00080000:2.0:1788796740.955304:0:12649:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788796740.955325:0:12649:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd2630b4000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1788796740.955347:0:12649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27b4f9500 x1875688959338880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788796740.955566:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3305:1875688959338752:0@lo:400:kworker.0 00000100:00100000:1.0:1788796740.955632:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788796740.955807:0:12649:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788796740.955812:0:12649:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788796740.955814:0:12649:0:(import.c:65:import_set_state_nolock()) ffff9bd27b4e5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788796740.955818:0:12649:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 457 00000100:00080000:2.0:1788796740.955821:0:12649:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788796740.955827:0:12649:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd27b4e5000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1788796740.955843:0:12649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27b4fb800 x1875688959339008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788796740.955893:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959338880:0@lo:8:kworker.0 00000400:00000100:2.0:1788796740.956154:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875688959338880 offset 0 length 520: 4 00000100:00100000:2.0:1788796740.956175:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959339008:0@lo:8:kworker.0 00000400:00000100:2.0:1788796740.956255:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875688959339008 offset 0 length 520: 4 00000100:00100000:2.0:1788796740.956279:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788796740.956286:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959339136:0@lo:400:kworker.0 00000100:00100000:2.0:1788796740.956313:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796740.956504:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959339136 00000100:00100000:2.0:1788796740.956513:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959339136 00000100:00100000:2.0:1788796740.956561:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788796740.956571:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959339136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796740.956624:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959339136:12345-0@lo:400:kworker.0 Request processed in 55us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796740.956632:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788796740.956683:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd27b4f8700 x1875688959339136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796740.956697:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959339136:0@lo:400:kworker.0 00000100:00100000:1.0:1788796740.957840:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959338752 00000100:00100000:1.0:1788796740.957851:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959338752 00000100:00100000:1.0:1788796740.957891:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788796740.957915:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:3305:x1875688959338752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796740.957977:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:3305:x1875688959338752:12345-0@lo:400:kworker.0 Request processed in 79us (2344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796740.957984:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788796740.958029:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3305:1875688959338752:0@lo:400:kworker.0 10000000:01000000:0.0:1788796741.288023:0:14367:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788796741.288032:0:14367:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd27e170800 from 10 10000000:01000000:0.0:1788796741.288038:0:14367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788796741.288083:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2374d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796741.288096:0:14367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2374d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796741.288106:0:14367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2374d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796741.288132:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959339264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788796741.288196:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796741.288240:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959339264 00000100:00100000:0.0:1788796741.288248:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959339264 00000100:00100000:0.0:1788796741.288298:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788796741.288309:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+11:14367:x1875688959339264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788796741.288322:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796741.288335:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe23754 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2374d expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796741.288373:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe23754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2374d expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796741.288385:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe23754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2374d expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796741.288395:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d4000, rc 0) 00000100:00100000:0.0:1788796741.288435:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14367:x1875688959339264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796741.288442:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788796741.288504:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788796741.288524:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959339264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788796741.288538:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2374d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23754 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796741.288547:0:14367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2374d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe23754 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796741.288599:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959339392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796741.288624:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796741.288648:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250a83c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788796741.292816:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959339392 00000100:00100000:0.0:1788796741.292836:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959339392 00000100:00100000:0.0:1788796741.292895:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788796741.292916:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14367:x1875688959339392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796741.293201:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14367:x1875688959339392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (4574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796741.293209:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788796741.293274:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959339392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788796741.293325:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959339520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796741.293381:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796741.293404:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959339520 00000100:00100000:0.0:1788796741.293408:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959339520 00000100:00100000:0.0:1788796741.293434:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788796741.293440:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14367:x1875688959339520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788796741.293597:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:14367:x1875688959339520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796741.293604:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788796741.293648:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27257ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796741.293981:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959339520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788796741.295450:0:14863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788796741.295548:0:14367:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788796741.295572:0:14367:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788796741.295584:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2374d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23754 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796741.295596:0:14367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2374d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23754 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796741.346621:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796742.367187:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788796742.874489:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788796743.391591:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796744.411001:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788796745.346657:0:15051:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788796745.346663:0:15051:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788796745.346797:0:15051:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd25020a800 00000020:01000004:1.0:1788796745.346813:0:15051:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788796745.346824:0:15051:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788796745.346837:0:15051:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bd2460719b8) 00000020:00000080:1.0:1788796745.346852:0:15051:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788796745.404645:0:15051:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788796745.404978:0:15051:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788796745.410368:0:15051:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788796745.410655:0:15051:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788796745.412127:0:15051:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788796745.412564:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 693: rc = 0 00100000:10000000:3.0:1788796745.412654:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 693: rc = 0 00100000:10000000:3.0:1788796745.412773:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 693: rc = 0 00100000:10000000:3.0:1788796745.422547:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 528: rc = 0 00100000:10000000:3.0:1788796745.424262:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 528: rc = 0 00100000:10000000:3.0:1788796745.424582:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 528: rc = 0 00100000:10000000:2.0:1788796745.426875:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 528: rc = 0 00100000:10000000:2.0:1788796745.427706:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 528: rc = 0 00100000:10000000:2.0:1788796745.432120:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 528: rc = 0 00000020:00000080:2.0:1788796745.432722:0:15051:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788796745.432733:0:15051:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788796745.432742:0:15051:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdd273c88cfe23762 00000020:01000004:2.0:1788796745.432771:0:15051:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788796745.432791:0:15051:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788796745.432794:0:15051:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788796745.432800:0:15051:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788796745.432805:0:15051:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788796745.432816:0:15051:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9bd267693370) 00000020:00000080:2.0:1788796745.432825:0:15051:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788796745.433991:0:15051:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788796745.434143:0:15051:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788796745.434150:0:15051:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00010000:00010000:3.0:1788796745.434287:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796745.439210:0:15051:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788796745.439226:0:15051:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788796745.441191:0:15051:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788796745.441202:0:15051:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788796745.442772:0:15051:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788796745.443185:0:15051:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788796745.443192:0:15051:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788796745.448265:0:15051:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788796745.448282:0:15051:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788796745.482265:0:15051:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788796745.482547:0:15051:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788796745.482555:0:15051:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788796745.486508:0:15051:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788796745.486525:0:15051:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788796745.490150:0:15051:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788796745.490170:0:15051:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788796745.492911:0:15051:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788796745.493110:0:15051:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788796745.493117:0:15051:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788796745.493933:0:15051:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788796745.493948:0:15051:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788796745.561206:0:15051:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788796745.561583:0:15051:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788796745.561591:0:15051:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788796745.562990:0:15051:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788796745.563001:0:15051:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788796745.563639:0:15051:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788796745.563663:0:15051:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788796745.563670:0:15051:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788796745.582910:0:15051:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788796745.583042:0:15051:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.125@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788796745.583046:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788796745.583048:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788796745.583050:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788796745.583051:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788796745.583053:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788796745.583054:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788796745.583056:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788796745.583058:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788796745.583059:0:15051:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788796745.583063:0:15051:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788796745.583064:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788796745.583066:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788796745.583067:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788796745.583068:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788796745.583069:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788796745.583070:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788796745.583071:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788796745.583072:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788796745.583074:0:15051:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788796745.583110:0:15051:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788796745.583130:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959339648:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788796745.583196:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796745.583284:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2503fc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796745.583391:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959339648 00000100:00100000:2.0:1788796745.583400:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959339648 00000100:00100000:2.0:1788796745.583590:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788796745.583601:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:15051:x1875688959339648:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788796745.583638:0:14362:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788796745.583641:0:14362:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788796745.583645:0:14362:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788796745.601741:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:15051:x1875688959339648:12345-0@lo:253:mount.lustre.0 Request processed in 18132us (18533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796745.601807:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788796745.602073:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959339648:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788796745.602112:0:15051:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788796745.602116:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788796745.602118:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788796745.602119:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788796745.602121:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788796745.602122:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788796745.602123:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788796745.602125:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788796745.602126:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788796745.602128:0:15051:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788796745.602148:0:15051:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd25020a800 from lustre-OST0000 10000000:01000000:0.0:1788796745.602181:0:15051:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788796745.602184:0:15051:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788796745.602192:0:15051:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd2673e0000 local copy 00010000:00010000:0.0:1788796745.602204:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d21800/0xdd273c88cfe23658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2365f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796745.602640:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959339776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788796745.602678:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796745.602722:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2503fc600 going to sleep for 11 seconds 00000100:00100000:2.0:1788796745.603052:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959339776 00000100:00100000:2.0:1788796745.603059:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959339776 00000100:00100000:2.0:1788796745.603097:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788796745.603105:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:15051:x1875688959339776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788796745.603512:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:15051:x1875688959339776:12345-0@lo:501:mount.lustre.0 Request processed in 398us (824us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788796745.603519:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788796745.606293:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959339776:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788796745.606331:0:15051:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788796745.606763:0:15051:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788796745.606773:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d21800/0xdd273c88cfe23658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2365f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.606785:0:15051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd247d21800/0xdd273c88cfe23658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2365f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796745.606823:0:15051:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd25020a800 10000000:01000000:1.0:1788796745.606828:0:15051:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788796745.606832:0:15051:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bd2673e0000 10000000:01000000:1.0:1788796745.606835:0:15051:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788796745.606838:0:15051:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9bd2673e0000 from 1 10000000:01000000:1.0:1788796745.606842:0:15051:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788796745.606974:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267335e00/0xdd273c88cfe23770 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.606984:0:15051:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd267335e00/0xdd273c88cfe23770 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.606995:0:15051:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd267335e00/0xdd273c88cfe23770 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796745.607015:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959339904:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788796745.607075:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796745.607122:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796745.607260:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959339904 00000100:00100000:2.0:1788796745.607268:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959339904 00000100:00100000:0.0:1788796745.607439:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788796745.607451:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+12:15051:x1875688959339904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788796745.607464:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796745.607476:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe23777 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe23770 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796745.607497:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe23777 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe23770 expref: 13 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796745.607518:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2821d4200/0xdd273c88cfe23777 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe23770 expref: 13 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796745.607536:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2821d4200, rc 0) 00000100:00100000:0.0:1788796745.607580:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+13:15051:x1875688959339904:12345-0@lo:101:mount.lustre.0 Request processed in 132us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796745.607587:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788796745.607773:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959339904:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788796745.607788:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd267335e00/0xdd273c88cfe23770 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23777 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.607808:0:15051:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd267335e00/0xdd273c88cfe23770 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe23777 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796745.607823:0:15051:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788796745.607836:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267335e00/0xdd273c88cfe23770 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23777 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.607843:0:15051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd267335e00/0xdd273c88cfe23770 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23777 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796745.607850:0:15051:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788796745.607854:0:15051:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788796745.607858:0:15051:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788796745.607860:0:15051:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788796745.607965:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267334800/0xdd273c88cfe2377e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.607974:0:15051:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd267334800/0xdd273c88cfe2377e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.607982:0:15051:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd267334800/0xdd273c88cfe2377e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796745.607995:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340032:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788796745.608023:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796745.608055:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb789c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796745.608114:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959340032 00000100:00100000:3.0:1788796745.608119:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959340032 00000100:00100000:3.0:1788796745.608151:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788796745.608158:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+13:15051:x1875688959340032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788796745.608165:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796745.608172:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d21e00/0xdd273c88cfe23785 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2377e expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796745.608186:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d21e00/0xdd273c88cfe23785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2377e expref: 14 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796745.608194:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d21e00/0xdd273c88cfe23785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2377e expref: 14 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796745.608201:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21e00, rc 0) 00000100:00100000:3.0:1788796745.608226:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+14:15051:x1875688959340032:12345-0@lo:101:mount.lustre.0 Request processed in 68us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796745.608231:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788796745.608547:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788796745.608558:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd267334800/0xdd273c88cfe2377e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23785 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.608565:0:15051:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd267334800/0xdd273c88cfe2377e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe23785 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788796745.609997:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788796745.612026:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788796745.612685:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788796745.613002:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788796745.613061:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788796745.613118:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788796745.613153:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788796745.613188:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788796745.613663:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788796745.613673:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788796745.614041:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788796745.614109:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796745.614196:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788796745.614378:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959340160 00000100:00100000:2.0:1788796745.614397:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959340160 00000100:00100000:2.0:1788796745.614676:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788796745.614687:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+14:15051:x1875688959340160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788796745.615122:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+14:15051:x1875688959340160:12345-0@lo:501:mount.lustre.0 Request processed in 436us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796745.615139:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788796745.615228:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788796745.615281:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340288:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788796745.615335:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796745.616225:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796745.616363:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959340288 00000100:00100000:0.0:1788796745.616371:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959340288 00000100:00100000:0.0:1788796745.616429:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788796745.616438:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+14:15051:x1875688959340288:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788796745.616842:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+14:15051:x1875688959340288:12345-0@lo:503:mount.lustre.0 Request processed in 405us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796745.616850:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788796745.617032:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340288:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788796745.617584:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788796745.617648:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788796745.617690:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796745.617711:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796745.618090:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959340416 00000100:00100000:0.0:1788796745.618096:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959340416 00000100:00100000:0.0:1788796745.618117:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788796745.618124:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+14:15051:x1875688959340416:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788796745.618496:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+14:15051:x1875688959340416:12345-0@lo:502:mount.lustre.0 Request processed in 372us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796745.618563:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788796745.618787:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788796745.619170:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788796745.619220:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788796745.619403:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788796745.619608:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788796745.619651:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788796745.619685:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788796745.620367:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788796745.620613:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788796745.620662:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788796745.620735:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788796745.623740:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788796745.623848:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788796745.624131:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788796745.624220:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796745.624443:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796745.624594:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959340544 00000100:00100000:0.0:1788796745.624605:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959340544 00000100:00100000:0.0:1788796745.624659:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788796745.624668:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+14:15051:x1875688959340544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788796745.625050:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+14:15051:x1875688959340544:12345-0@lo:502:mount.lustre.0 Request processed in 381us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796745.625058:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788796745.625148:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788796745.625366:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788796745.625381:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788796745.627016:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788796745.627028:0:15065:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788796745.627035:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796745.627038:0:15065:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788796745.627043:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788796745.627062:0:15065:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9bd2466ccd28) 00000020:00000080:3.0:1788796745.627088:0:15065:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788796745.627094:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788796745.627163:0:15065:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd25020a800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788796745.627172:0:15065:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788796745.627180:0:15065:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdd273c88cfe23793 00010000:00010000:3.0:1788796745.633051:0:15065:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788796745.633907:0:15065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788796745.641701:0:15065:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788796745.643716:0:15065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788796745.643731:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796745.643737:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796745.643739:0:15065:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788796745.643742:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788796745.643778:0:15065:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788796745.643779:0:15065:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788796745.643781:0:15065:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788796745.643782:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788796745.643785:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796745.643787:0:15065:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788796745.643790:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796745.643793:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796745.643794:0:15065:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788796745.643797:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788796745.643799:0:15065:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788796745.643801:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796745.643803:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796745.643804:0:15065:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788796745.643807:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796745.643808:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796745.643810:0:15065:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788796745.643812:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788796745.643871:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796745.643887:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796745.643889:0:15065:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788796745.643893:0:15065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788796745.644108:0:15051:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788796745.644136:0:15051:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788796745.644162:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267334800/0xdd273c88cfe2377e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23785 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.644175:0:15051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd267334800/0xdd273c88cfe2377e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23785 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796745.644183:0:15051:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd25020a800 from 1 10000000:01000000:1.0:1788796745.644186:0:15051:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788796745.644221:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe2379a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.644230:0:15051:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe2379a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.644242:0:15051:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe2379a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796745.644266:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788796745.644355:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796745.644411:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb789c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796745.644672:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959340672 00000100:00100000:3.0:1788796745.644680:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959340672 00000100:00100000:3.0:1788796745.644727:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788796745.644738:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+14:15051:x1875688959340672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788796745.644775:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796745.644788:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe237a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe2379a expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796745.644827:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe237a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe2379a expref: 15 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796745.644837:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe237a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2379a expref: 15 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796745.644846:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21a00, rc 0) 00000100:00100000:3.0:1788796745.644886:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+15:15051:x1875688959340672:12345-0@lo:101:mount.lustre.0 Request processed in 150us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796745.644893:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788796745.645067:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788796745.645083:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe2379a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe237a1 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.645093:0:15051:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe2379a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe237a1 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788796745.645732:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788796745.646700:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788796745.647018:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788796745.647065:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788796745.647130:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788796745.647139:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788796745.647223:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788796745.647286:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796745.647351:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796745.647823:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959340800 00000100:00100000:2.0:1788796745.647833:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959340800 00000100:00100000:2.0:1788796745.647965:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788796745.647976:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+15:15051:x1875688959340800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788796745.648262:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+15:15051:x1875688959340800:12345-0@lo:501:mount.lustre.0 Request processed in 286us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796745.648269:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788796745.649182:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788796745.649312:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788796745.649370:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796745.655130:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb789c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796745.660224:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959340928 00000100:00100000:3.0:1788796745.660243:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959340928 00000100:00100000:3.0:1788796745.660317:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788796745.660329:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+15:15051:x1875688959340928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788796745.660781:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+15:15051:x1875688959340928:12345-0@lo:503:mount.lustre.0 Request processed in 453us (11410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796745.660802:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788796745.662086:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959340928:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788796745.662647:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788796745.662737:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959341056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788796745.662825:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796745.662870:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959341056 00000100:00100000:1.0:1788796745.662873:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb789c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796745.662950:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959341056 00000100:00100000:3.0:1788796745.662984:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788796745.662992:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+15:15051:x1875688959341056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788796745.663171:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+15:15051:x1875688959341056:12345-0@lo:502:mount.lustre.0 Request processed in 178us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796745.663179:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788796745.663281:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959341056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788796745.663511:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788796745.663559:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788796745.663607:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788796745.663646:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788796745.663680:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788796745.663726:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788796745.663784:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788796745.663819:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788796745.663849:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959341184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788796745.663889:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796745.664005:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959341184 00000100:00100000:3.0:1788796745.664011:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959341184 00000100:00100000:3.0:1788796745.664042:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788796745.664049:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+15:15051:x1875688959341184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788796745.664184:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+15:15051:x1875688959341184:12345-0@lo:502:mount.lustre.0 Request processed in 134us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796745.664191:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788796745.664465:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb789c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796745.664483:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959341184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788796745.664565:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788796745.664575:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788796745.666594:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796745.666608:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796745.666611:0:15069:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788796745.666620:0:15069:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd25020a800 00000020:00000080:2.0:1788796745.666622:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788796745.666630:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796745.666633:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796745.666635:0:15069:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788796745.666637:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796745.666640:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796745.666641:0:15069:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788796745.666644:0:15069:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd25020a800 00000020:00000080:2.0:1788796745.666647:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788796745.666712:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796745.666716:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796745.666717:0:15069:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788796745.666720:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796745.666722:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796745.666723:0:15069:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788796745.666727:0:15069:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd25020a800 00000020:00000080:2.0:1788796745.666729:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788796745.666811:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796745.666815:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796745.666816:0:15069:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788796745.666819:0:15069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788796745.672005:0:15051:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788796745.672045:0:15051:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788796745.672069:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe2379a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe237a1 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796745.672084:0:15051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe2379a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe237a1 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788796745.672132:0:15051:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788796745.672134:0:15051:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd25020a800 10000000:01000000:0.0:1788796745.672137:0:15051:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd25020a800 10000000:01000000:0.0:1788796745.672140:0:15051:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788796745.672146:0:15051:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd25020a800 from 1 10000000:01000000:0.0:1788796745.672148:0:15051:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788796745.672186:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4800/0xdd273c88cfe237a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796745.672194:0:15051:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4800/0xdd273c88cfe237a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796745.672205:0:15051:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4800/0xdd273c88cfe237a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796745.672229:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e379180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959341312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788796745.672294:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796745.672354:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27eb30240 going to sleep for 11 seconds 00000100:00100000:3.0:1788796745.676631:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959341312 00000100:00100000:3.0:1788796745.676648:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959341312 00000100:00100000:3.0:1788796745.676710:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788796745.676720:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+15:15051:x1875688959341312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788796745.676738:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796745.676774:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d21000/0xdd273c88cfe237af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe237a8 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796745.676806:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d21000/0xdd273c88cfe237af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe237a8 expref: 16 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796745.676818:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d21000/0xdd273c88cfe237af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe237a8 expref: 16 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796745.676827:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21000, rc 0) 00000100:00100000:3.0:1788796745.676921:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15051:x1875688959341312:12345-0@lo:101:mount.lustre.0 Request processed in 202us (4626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796745.676928:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788796745.678828:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e379180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959341312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788796745.678854:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4800/0xdd273c88cfe237a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe237af expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796745.678866:0:15051:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4800/0xdd273c88cfe237a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe237af expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788796745.680018:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788796745.680714:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788796745.684636:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788796745.684733:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788796745.684797:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788796745.684863:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788796745.684914:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788796745.684963:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788796745.684999:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788796745.685033:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788796745.685083:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788796745.685129:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788796745.685158:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788796745.685198:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788796745.685231:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788796745.685261:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788796745.685310:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788796745.685345:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788796745.685377:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788796745.686015:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788796745.686059:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788796745.686091:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788796745.686140:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788796745.686172:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788796745.686199:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788796745.686242:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788796745.686275:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788796745.686326:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788796745.686376:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788796745.689022:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788796745.689173:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788796745.689190:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788796745.689299:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959341440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788796745.689370:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796745.689416:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788796745.690872:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959341440 00000100:00100000:0.0:1788796745.690960:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959341440 00000100:00100000:0.0:1788796745.691023:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788796745.691034:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15051:x1875688959341440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788796745.691321:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15051:x1875688959341440:12345-0@lo:501:mount.lustre.0 Request processed in 289us (1949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796745.691329:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788796745.692131:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959341440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788796745.692183:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959341568:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788796745.692230:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796745.692260:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959341568 00000100:00100000:3.0:1788796745.692265:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959341568 00000100:00100000:3.0:1788796745.692302:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788796745.692310:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15051:x1875688959341568:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788796745.693614:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15051:x1875688959341568:12345-0@lo:503:mount.lustre.0 Request processed in 1301us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796745.693625:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788796745.693677:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796745.693693:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959341568:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788796745.697104:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788796745.697210:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959341696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788796745.697279:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796745.697318:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959341696 00000100:00100000:3.0:1788796745.697325:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959341696 00000100:00100000:3.0:1788796745.697363:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788796745.697371:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15051:x1875688959341696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788796745.700820:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd267a14c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796745.701082:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15051:x1875688959341696:12345-0@lo:502:mount.lustre.0 Request processed in 3705us (3796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796745.701108:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788796745.702018:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959341696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788796745.702320:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788796745.702379:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788796745.703611:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788796745.703705:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788796745.703770:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788796745.703824:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788796745.703859:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788796745.704553:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788796745.704605:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788796745.704639:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788796745.704671:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788796745.704733:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788796745.707529:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788796745.707588:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788796745.707668:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788796745.707708:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788796745.707859:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788796745.707933:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788796745.707973:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788796745.708031:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788796745.708083:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788796745.708121:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788796745.708155:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788796745.708201:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788796745.708237:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788796745.708272:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788796745.709055:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788796745.709098:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788796745.709128:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788796745.709174:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788796745.709208:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788796745.709240:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788796745.709274:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788796745.710064:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788796745.710108:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788796745.710168:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788796745.710197:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788796745.710224:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788796745.710260:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788796745.710289:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788796745.712486:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959341824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788796745.712577:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796745.712624:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959341824 00000100:00100000:1.0:1788796745.712633:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959341824 00000100:00100000:1.0:1788796745.712682:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788796745.712693:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15051:x1875688959341824:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788796745.712955:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15051:x1875688959341824:12345-0@lo:502:mount.lustre.0 Request processed in 263us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796745.712964:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788796745.713019:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd279503a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788796745.713041:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959341824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788796745.713146:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788796745.713162:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788796745.724557:0:15074:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788796745.724579:0:15074:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bd26caa19b8) 00000020:00000080:2.0:1788796745.724602:0:15074:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788796745.724679:0:15074:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd25020a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788796745.724684:0:15074:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd25020a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788796745.724687:0:15074:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd25020a800 3 00010000:00080000:2.0:1788796745.724718:0:15074:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd27ce2d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.125@tcp at head 00010000:00010000:2.0:1788796745.729890:0:15074:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788796745.730106:0:15074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788796745.730150:0:15074:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788796745.730164:0:15074:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdd273c88cfe237bd 00000100:00080000:2.0:1788796745.730175:0:15074:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788796745.730187:0:15074:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bd27ce2d800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1788796745.730226:0:15074:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27b4f8700 x1875688959341952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788796745.730279:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875688959341952:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788796745.730351:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788796745.730430:0:15074:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788796745.730726:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959341952 00000100:00100000:3.0:1788796745.730735:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959341952 00000100:00100000:3.0:1788796745.730786:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788796745.730793:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875688959341952:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788796745.730818:0:14369:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:3.0:1788796745.730847:0:14369:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdd273c88cfe237c4 00000004:00100000:3.0:1788796745.730863:0:14369:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788796745.730893:0:14369:0:(import.c:65:import_set_state_nolock()) ffff9bd27cd51000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788796745.730947:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875688959341952:12345-0@lo:38:llog_process_th.0 Request processed in 153us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796745.730954:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788796745.730975:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788796745.730980:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788796745.730983:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788796745.730986:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788796745.731026:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959342080:0@lo:400:kworker.0 00000100:00100000:3.0:1788796745.731052:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796745.731085:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959342080 00000100:00100000:3.0:1788796745.731089:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959342080 00000100:00100000:3.0:1788796745.731113:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788796745.731119:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959342080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796745.731153:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875688959342080:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796745.731166:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788796745.731198:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd26799ad80 x1875688959342080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796745.731212:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875688959342080:0@lo:400:kworker.0 00010000:00080000:3.0:1788796745.731240:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bd27b4f8700 x1875688959341952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788796755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796745.731248:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788796745.731255:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788796745.731262:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788796745.731266:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788796745.731268:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd27ce2d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788796745.731274:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875688959341952:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788796745.732060:0:15074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788796745.733725:0:15051:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788796745.733790:0:15051:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788796745.733812:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4800/0xdd273c88cfe237a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe237af expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.733825:0:15051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd2821d4800/0xdd273c88cfe237a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe237af expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788796745.733889:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788796745.733891:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788796745.733892:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788796745.733894:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788796745.733895:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788796745.733896:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788796745.733897:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788796745.733899:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788796745.733900:0:15051:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788796745.733904:0:15051:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788796745.733906:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788796745.733908:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788796745.733909:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788796745.733910:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788796745.733923:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788796745.733925:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788796745.733926:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788796745.733927:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788796745.733928:0:15051:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788796745.733953:0:15051:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788796745.733971:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959342208:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788796745.734036:0:15051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796745.734072:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd279503a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788796745.735439:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959342208 00000100:00100000:3.0:1788796745.735452:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959342208 00000100:00100000:3.0:1788796745.735500:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788796745.735510:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15051:x1875688959342208:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788796745.735542:0:14364:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788796745.735556:0:14364:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788796745.787300:0:14364:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788796745.787325:0:14364:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788796745.787454:0:14385:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788796745.787461:0:14385:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788796745.787487:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd2821d4a00/0xdd273c88cfe237cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796745.787924:0:14385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd247d20a00/0xdd273c88cfe23738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe23731 expref: 16 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796745.787931:0:14385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd2821d4a00/0xdd273c88cfe237cb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796745.788177:0:14385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd247d20a00/0xdd273c88cfe23738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe23731 expref: 16 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796745.788195:0:14385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd247d20a00/0xdd273c88cfe23738 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe23731 expref: 16 pid: 14362 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796745.788211:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14385:1875688959342336:0@lo:104: 00000100:00100000:2.0:1788796745.788297:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796745.788348:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2673afa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796745.791173:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959342336 00000100:00100000:0.0:1788796745.791202:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959342336 00000100:00100000:0.0:1788796745.791297:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788796745.791307:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+3:14385:x1875688959342336:12345-0@lo:104: 00010000:00010000:0.0:1788796745.791322:0:14353:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5200/0xdd273c88cfe23731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe23738 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796745.791447:0:14353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788796745.791454:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+3:14385:x1875688959342336:12345-0@lo:104: Request processed in 149us (3157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796745.791461:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788796745.791538:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14385:1875688959342336:0@lo:104: 00010000:00010000:3.0:1788796745.791564:0:14385:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd2821d4a00/0xdd273c88cfe237cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.791566:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796745.791577:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5200/0xdd273c88cfe23731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe23738 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.791596:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5200 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:1.0:1788796745.791601:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5200/0xdd273c88cfe23731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe23738 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.791619:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5200/0xdd273c88cfe23731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe23738 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788796745.791626:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5200/0xdd273c88cfe23731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe23738 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796745.791632:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788796745.791679:0:14357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5200/0xdd273c88cfe23731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe23738 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.791687:0:14357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788796745.791723:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5200/0xdd273c88cfe23731 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe23738 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.791731:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5200/0xdd273c88cfe23731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe23738 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796745.791783:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796745.791785:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796745.791787:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796745.792069:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3304:1875688959342464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796745.792114:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796745.800704:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15051:x1875688959342208:12345-0@lo:253:mount.lustre.0 Request processed in 65185us (66658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796745.800717:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788796745.800796:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15051:1875688959342208:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788796745.800809:0:15051:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788796745.800812:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788796745.800814:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788796745.800815:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788796745.800816:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788796745.800829:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788796745.800830:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788796745.800831:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788796745.800832:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788796745.800833:0:15051:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788796745.800848:0:15051:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788796745.803150:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959342464 00000100:00100000:2.0:1788796745.803166:0:14356:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959342464 00010000:00010000:2.0:1788796745.803219:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd247d20a00/0xdd273c88cfe23738 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe23731 expref: 16 pid: 14362 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796745.803327:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788796745.803336:0:14356:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:3304:x1875688959342464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788796745.803351:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796745.803356:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd247d20a00/0xdd273c88cfe23738 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe23731 expref: 16 pid: 14362 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796745.803370:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd247d20a00/0xdd273c88cfe23738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe23731 expref: 16 pid: 14362 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796745.803398:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d20a00/0xdd273c88cfe23738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe23731 expref: 16 pid: 14362 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796745.803417:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd2821d4a00/0xdd273c88cfe237cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796745.803425:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2821d4a00/0xdd273c88cfe237cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788796745.803443:0:14356:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015982558s 00010000:00010000:2.0:1788796745.803447:0:14356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd2821d4a00/0xdd273c88cfe237cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796745.803454:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd2821d4a00/0xdd273c88cfe237cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796745.803462:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd2821d4a00/0xdd273c88cfe237cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796745.803469:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd2821d4a00/0xdd273c88cfe237cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796745.803482:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4a00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796745.803487:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd2821d4a00/0xdd273c88cfe237cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796745.803496:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd2821d4a00/0xdd273c88cfe237cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796745.803517:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd2821d4a00/0xdd273c88cfe237cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796745.803528:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796745.803594:0:14356:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+15:3304:x1875688959342464:12345-0@lo:103:ldlm_bl.0 Request processed in 259us (11479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796745.803601:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788796745.803660:0:14385:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd2821d4a00/0xdd273c88cfe237cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796745.803669:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd2821d4a00/0xdd273c88cfe237cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796745.803675:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd2821d4a00/0xdd273c88cfe237cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796745.804438:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3304:1875688959342464:0@lo:103:ldlm_bl.0 00080000:10000000:1.0:1788796745.807550:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788796745.808004:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788796745.808170:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788796745.809121:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788796745.811171:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788796745.811642:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788796745.812644:0:15051:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788796745.908069:0:15051:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788796745.908081:0:15051:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788796745.908137:0:15051:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788796745.908197:0:15051:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788796745.908212:0:15051:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788796745.908241:0:15051:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788796746.461410:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788796747.226186:0:14367:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788796747.226200:0:14367:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd27e170800 from 7 10000000:01000000:3.0:1788796747.226206:0:14367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788796747.228538:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20800/0xdd273c88cfe237d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796747.228565:0:14367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd247d20800/0xdd273c88cfe237d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796747.228581:0:14367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd247d20800/0xdd273c88cfe237d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796747.228621:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959342592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788796747.228712:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796747.228799:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24db48240 going to sleep for 11 seconds 00000100:00100000:1.0:1788796747.229020:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959342592 00000100:00100000:1.0:1788796747.229032:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959342592 00000100:00100000:1.0:1788796747.229099:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788796747.229110:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+15:14367:x1875688959342592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796747.229124:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796747.229145:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd267335400/0xdd273c88cfe237d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe237d2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796747.229172:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd267335400/0xdd273c88cfe237d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe237d2 expref: 16 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796747.229184:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd267335400/0xdd273c88cfe237d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe237d2 expref: 16 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796747.229228:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd267335400, rc 0) 00000100:00100000:1.0:1788796747.229289:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:14367:x1875688959342592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796747.229296:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788796747.229569:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959342592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796747.229591:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd247d20800/0xdd273c88cfe237d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe237d9 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796747.229616:0:14367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd247d20800/0xdd273c88cfe237d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe237d9 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796747.229689:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959342720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788796747.229733:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796747.229793:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24db48240 going to sleep for 11 seconds 00000100:00100000:1.0:1788796747.229853:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959342720 00000100:00100000:1.0:1788796747.229859:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959342720 00000100:00100000:1.0:1788796747.229890:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788796747.229897:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:14367:x1875688959342720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788796747.229912:0:14364:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788796747.229931:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788796747.229934:0:14364:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788796747.230030:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:14367:x1875688959342720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796747.230038:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788796747.230122:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959342720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788796747.230177:0:14367:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788796747.230184:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d20800/0xdd273c88cfe237d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe237d9 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796747.230193:0:14367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd247d20800/0xdd273c88cfe237d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe237d9 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796747.487298:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796748.506965:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796749.530787:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796750.556603:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788796751.195733:0:12649:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788796751.195741:0:12649:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788796751.195758:0:12649:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788796751.195761:0:12649:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788796751.195812:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3305:1875688959342848:0@lo:400:kworker.0 00000100:00100000:3.0:1788796751.195886:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796751.195954:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959342976:0@lo:400:kworker.0 00000100:00100000:3.0:1788796751.195982:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796751.196016:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796751.196021:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959343104:0@lo:400:kworker.0 00000100:00100000:3.0:1788796751.196043:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796751.196302:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959342848 00000100:00100000:3.0:1788796751.196312:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959342848 00000100:00100000:3.0:1788796751.196364:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788796751.196373:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:3305:x1875688959342848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796751.196426:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:3305:x1875688959342848:12345-0@lo:400:kworker.0 Request processed in 54us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796751.196434:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788796751.196467:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959342976 00000100:00100000:3.0:1788796751.196471:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959342976 00000100:00100000:3.0:1788796751.196568:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959343104 00000100:00100000:3.0:1788796751.196572:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959343104 00000100:00100000:3.0:1788796751.196597:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788796751.196604:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959342976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796751.196641:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959342976:12345-0@lo:400:kworker.0 Request processed in 38us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796751.196647:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788796751.196658:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788796751.196664:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959343104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796751.196690:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959343104:12345-0@lo:400:kworker.0 Request processed in 26us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796751.196695:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788796751.196741:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd26799aa00 x1875688959343104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796751.196780:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959343104:0@lo:400:kworker.0 00010000:00080000:3.0:1788796751.196805:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd26799a300 x1875688959342976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796751.196814:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959342976:0@lo:400:kworker.0 00000100:00100000:3.0:1788796751.196841:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3305:1875688959342848:0@lo:400:kworker.0 00000100:00080000:1.0:1788796751.196992:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788796751.577907:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788796752.091254:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788796752.602534:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788796752.649389:0:15417:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788796753.625968:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796754.664830:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796755.679359:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796756.004417:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788796740/real 1788796740] req@ffff9bd27b4f9500 x1875688959338880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788796755 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796756.004451:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd27b4f9500 x1875688959338880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788796755 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796756.004462:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788796740/real 1788796740] req@ffff9bd27b4fb800 x1875688959339008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788796755 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796756.004474:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bd27b4fb800 x1875688959339008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788796755 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788796756.004494:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd2630b4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788796756.004680:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788796756.004685:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959338880:0@lo:8:kworker.0 00000100:00080000:2.0:1788796756.004702:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd27b4e5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788796756.009703:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788796756.009711:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788796756.009715:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd2630b4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788796756.009723:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:3.0:1788796756.009729:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788796756.009741:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bd2630b4000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:3.0:1788796756.009779:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd26799a300 x1875688959343360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788796756.009792:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788796756.009796:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788796756.009797:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bd27b4e5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788796756.009801:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:3.0:1788796756.009804:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788796756.009808:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd27b4e5000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:3.0:1788796756.009821:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd26799aa00 x1875688959343488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788796756.012257:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3304:1875688959343232:0@lo:400:kworker.0 00000100:00100000:0.0:1788796756.012344:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796756.012436:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959343232 00000100:00100000:0.0:1788796756.012444:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959343232 00000100:00100000:0.0:1788796756.012497:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788796756.012507:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:3304:x1875688959343232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796756.012561:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:3304:x1875688959343232:12345-0@lo:400:kworker.0 Request processed in 56us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796756.012568:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788796756.012615:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3304:1875688959343232:0@lo:400:kworker.0 00000100:00080000:2.0:1788796756.012780:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788796756.012785:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959339008:0@lo:8:kworker.0 00000100:00100000:3.0:1788796756.012802:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959343616:0@lo:400:kworker.0 00000100:00100000:2.0:1788796756.012807:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959343360:0@lo:8:kworker.0 00000100:00100000:3.0:1788796756.012830:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796756.012860:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959343616 00000100:00100000:3.0:1788796756.012864:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959343616 00000100:00100000:3.0:1788796756.012892:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788796756.012899:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959343616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796756.012935:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959343616:12345-0@lo:400:kworker.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796756.012942:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788796756.012968:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd267998700 x1875688959343616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796756.012979:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959343616:0@lo:400:kworker.0 00000100:00100000:3.0:1788796756.013033:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788796756.013049:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875688959343744:0@lo:400:kworker.0 00000100:00100000:3.0:1788796756.013073:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796756.013100:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959343744 00000100:00100000:3.0:1788796756.013104:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959343744 00000100:00100000:2.0:1788796756.013115:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796756.013141:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788796756.013145:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959343488:0@lo:8:kworker.0 00000100:00100000:3.0:1788796756.013148:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875688959343744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796756.013169:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796756.013178:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875688959343744:12345-0@lo:400:kworker.0 Request processed in 31us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796756.013184:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788796756.013213:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959343360 00000100:00100000:2.0:1788796756.013217:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959343360 00010000:00080000:3.0:1788796756.013220:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd267998700 x1875688959343744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796756.013230:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875688959343744:0@lo:400:kworker.0 00000100:00100000:2.0:1788796756.013234:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959343488 00000100:00100000:2.0:1788796756.013236:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959343488 00000100:00100000:2.0:1788796756.013245:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788796756.013249:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875688959343360:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788796756.013271:0:15052:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000100:00080000:0.0:1788796756.013311:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1788796756.013346:0:15052:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd273c88cfe237e0 00002000:00100000:2.0:1788796756.013360:0:15052:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bd27ce2b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788796756.013365:0:15052:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788796756.013430:0:15052:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788796756.014146:0:15052:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788796756.014173:0:15052:0:(import.c:65:import_set_state_nolock()) ffff9bd27ce2d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788796756.017589:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875688959343360:12345-0@lo:8:kworker.0 Request processed in 4327us (4743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796756.017605:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788796756.017637:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788796756.017644:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875688959343488:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788796756.017663:0:15052:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788796756.017729:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875688959343488:12345-0@lo:8:kworker.0 Request processed in 83us (4558us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788796756.017735:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788796756.024570:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd26799a300 x1875688959343360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788796776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788796756.024589:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788796756.024618:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788796756.024628:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788796756.024634:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788796756.024638:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd2630b4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788796756.024671:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788796756.024679:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959343360:0@lo:8:kworker.0 00000100:00080000:0.0:1788796756.024702:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd27b4e5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788796756.024707:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788796756.024720:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959343488:0@lo:8:kworker.0 00000004:00080000:0.0:1788796756.024786:0:14391:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788796756.025078:0:14392:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788796756.025101:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14392:1875688959344000:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788796756.025165:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796756.025190:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd245956540 going to sleep for 11 seconds 00000100:00100000:3.0:1788796756.025211:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796756.025221:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959343872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796756.025245:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796756.025284:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959344000 00000100:00100000:3.0:1788796756.025290:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959344000 00000100:00100000:3.0:1788796756.025342:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788796756.025351:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14392:x1875688959344000:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1788796756.025997:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788796756.026021:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959343872 00000100:00100000:2.0:1788796756.026026:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959343872 00000100:00100000:2.0:1788796756.026052:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788796756.026061:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959343872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788796756.026085:0:15056:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788796756.026141:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959343872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796756.026148:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788796756.026215:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd267998700 x1875688959343872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796756.026233:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959343872:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788796756.027230:0:14391:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 483008481908ns, next at 0ns, rc = 0 00002000:00080000:3.0:1788796756.030506:0:15054:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788796756.030518:0:15054:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788796756.030524:0:15054:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1788796756.065479:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788796756.065494:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.065512:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1788796756.065517:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796756.065524:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.065543:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.065553:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.065567:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.065587:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788796756.065601:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796756.065606:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.065614:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21200 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796756.065619:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.065628:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.065646:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.065653:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.065670:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796756.065672:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796756.065674:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788796756.088774:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788796756.088797:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1a89b88/0xdd273c88cfe237ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.088814:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1788796756.088819:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796756.088825:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1a89b88/0xdd273c88cfe237ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.090616:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1a89b88/0xdd273c88cfe237ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.090637:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1a89b88/0xdd273c88cfe237ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.090645:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1a89b88/0xdd273c88cfe237ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.090736:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788796756.091427:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788796756.091435:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf1de98/0xdd273c88cfe237f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.091447:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1788796756.091452:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796756.091458:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf1de98/0xdd273c88cfe237f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.091470:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf1de98/0xdd273c88cfe237f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.091487:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf1de98/0xdd273c88cfe237f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.091494:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adf1de98/0xdd273c88cfe237f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.098615:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788796756.098632:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1a89b88/0xdd273c88cfe237ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.098647:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21400 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:1.0:1788796756.098652:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1a89b88/0xdd273c88cfe237ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.098663:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1a89b88/0xdd273c88cfe237ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.098708:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1a89b88/0xdd273c88cfe237ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.098716:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1a89b88/0xdd273c88cfe237ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.098976:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796756.098983:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adf1de98/0xdd273c88cfe237f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.098989:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20c00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796756.098993:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf1de98/0xdd273c88cfe237f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.099001:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf1de98/0xdd273c88cfe237f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.099026:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adf1de98/0xdd273c88cfe237f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.099034:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.099036:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.099038:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788796756.104711:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788796756.106270:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788796756.106284:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf1de98/0xdd273c88cfe237f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.106514:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788796756.109935:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788796756.109962:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.109979:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1788796756.109984:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796756.109991:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.110006:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.110017:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.110037:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.110065:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788796756.110733:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788796756.110741:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8ba085a/0xdd273c88cfe23803 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.110773:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1788796756.110776:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796756.110781:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8ba085a/0xdd273c88cfe23803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.110792:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8ba085a/0xdd273c88cfe23803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.110800:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8ba085a/0xdd273c88cfe23803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.110807:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8ba085a/0xdd273c88cfe23803 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.110828:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788796756.111358:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788796756.111368:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.111377:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21200 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796756.111382:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.111399:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.111420:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.111429:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000059be139/0xdd273c88cfe237fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.111463:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796756.111467:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8ba085a/0xdd273c88cfe23803 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.111474:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21c00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796756.111478:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8ba085a/0xdd273c88cfe23803 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.111486:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8ba085a/0xdd273c88cfe23803 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.111497:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8ba085a/0xdd273c88cfe23803 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.111504:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8ba085a/0xdd273c88cfe23803 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.111517:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796756.111519:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796756.111520:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796756.111917:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788796756.113365:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788796756.113383:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f886893e/0xdd273c88cfe2380a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.113526:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1788796756.113532:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796756.113538:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f886893e/0xdd273c88cfe2380a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.113555:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f886893e/0xdd273c88cfe2380a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.113566:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f886893e/0xdd273c88cfe2380a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.113573:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f886893e/0xdd273c88cfe2380a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.113641:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788796756.115257:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788796756.115270:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23811 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.115284:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1788796756.115287:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796756.115293:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.115305:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.115322:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.115330:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.118032:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788796756.118057:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f886893e/0xdd273c88cfe2380a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.118070:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20a00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796756.118081:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f886893e/0xdd273c88cfe2380a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.118092:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f886893e/0xdd273c88cfe2380a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.118111:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f886893e/0xdd273c88cfe2380a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.118119:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f886893e/0xdd273c88cfe2380a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.118386:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796756.118391:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.118407:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20000 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796756.118410:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.118418:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23811 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.118429:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23811 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.118436:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796756.118444:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796756.118446:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796756.118689:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788796756.118697:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a81c088/0xdd273c88cfe23811 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.118915:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788796756.136284:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.136301:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119d0b5c/0xdd273c88cfe23818 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.136319:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.136324:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.136330:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119d0b5c/0xdd273c88cfe23818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.136345:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119d0b5c/0xdd273c88cfe23818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.136357:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119d0b5c/0xdd273c88cfe23818 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.136365:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119d0b5c/0xdd273c88cfe23818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.138058:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788796756.138894:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.138903:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0ebb665/0xdd273c88cfe2381f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.138918:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.138922:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.138927:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0ebb665/0xdd273c88cfe2381f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.138950:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0ebb665/0xdd273c88cfe2381f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.138960:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0ebb665/0xdd273c88cfe2381f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.138967:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0ebb665/0xdd273c88cfe2381f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.140608:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788796756.140622:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119d0b5c/0xdd273c88cfe23818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.140639:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5e00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796756.140644:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119d0b5c/0xdd273c88cfe23818 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.140658:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119d0b5c/0xdd273c88cfe23818 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.140678:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119d0b5c/0xdd273c88cfe23818 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.140686:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119d0b5c/0xdd273c88cfe23818 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.140705:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796756.140708:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0ebb665/0xdd273c88cfe2381f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.140726:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4600 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796756.140730:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0ebb665/0xdd273c88cfe2381f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.140738:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0ebb665/0xdd273c88cfe2381f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.140775:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0ebb665/0xdd273c88cfe2381f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.140785:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.140786:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.140788:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796756.140952:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788796756.140959:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0ebb665/0xdd273c88cfe2381f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788796756.141733:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.141741:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe23826 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.141788:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.141793:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.141800:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe23826 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.141814:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe23826 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.141940:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796756.142326:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe23826 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.142335:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe23826 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.142357:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788796756.144161:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796756.144174:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe23826 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.144184:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5000 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796756.144188:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe23826 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.144208:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe23826 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.144228:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe23826 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.144244:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000230886e3/0xdd273c88cfe23826 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.144271:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.144273:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.144274:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788796756.147037:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.147062:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8bafb57/0xdd273c88cfe2382d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.147078:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.147083:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.147090:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8bafb57/0xdd273c88cfe2382d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.147105:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8bafb57/0xdd273c88cfe2382d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.147114:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8bafb57/0xdd273c88cfe2382d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.147122:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8bafb57/0xdd273c88cfe2382d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.148885:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788796756.151299:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796756.151314:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8bafb57/0xdd273c88cfe2382d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.151327:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5600 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796756.151332:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8bafb57/0xdd273c88cfe2382d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.151343:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8bafb57/0xdd273c88cfe2382d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.151364:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8bafb57/0xdd273c88cfe2382d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.151385:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8bafb57/0xdd273c88cfe2382d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.151426:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796756.151429:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796756.151430:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788796756.156339:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.156355:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae812d4e/0xdd273c88cfe23834 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.156374:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.156380:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.156386:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae812d4e/0xdd273c88cfe23834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.158895:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae812d4e/0xdd273c88cfe23834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.158913:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae812d4e/0xdd273c88cfe23834 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.158922:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae812d4e/0xdd273c88cfe23834 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.158958:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788796756.159499:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796756.159508:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae812d4e/0xdd273c88cfe23834 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.159517:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d4a00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796756.159522:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae812d4e/0xdd273c88cfe23834 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.159531:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae812d4e/0xdd273c88cfe23834 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.159548:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae812d4e/0xdd273c88cfe23834 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.159555:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae812d4e/0xdd273c88cfe23834 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.159578:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.159580:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.159581:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788796756.160550:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.160560:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2383b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.160574:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.160584:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.160591:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2383b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.160604:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2383b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.160614:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2383b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.160621:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2383b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.160645:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788796756.160814:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796756.160822:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2383b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.160841:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5200 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796756.160847:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2383b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.160856:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2383b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.160871:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2383b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.160880:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089efc06d/0xdd273c88cfe2383b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.160898:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796756.160900:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796756.160902:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788796756.161896:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.161904:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdcd3189/0xdd273c88cfe23842 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.161916:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.161920:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.161925:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdcd3189/0xdd273c88cfe23842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.161936:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdcd3189/0xdd273c88cfe23842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.161944:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdcd3189/0xdd273c88cfe23842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.161958:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdcd3189/0xdd273c88cfe23842 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.161977:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788796756.162235:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796756.162242:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdcd3189/0xdd273c88cfe23842 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.162249:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240030c00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796756.162254:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdcd3189/0xdd273c88cfe23842 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.162262:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdcd3189/0xdd273c88cfe23842 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.162276:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdcd3189/0xdd273c88cfe23842 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.162283:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdcd3189/0xdd273c88cfe23842 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.162299:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.162300:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.162302:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788796756.162783:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.162789:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaab94c3/0xdd273c88cfe23849 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.162798:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.162801:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.162805:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaab94c3/0xdd273c88cfe23849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.162815:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaab94c3/0xdd273c88cfe23849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.162823:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaab94c3/0xdd273c88cfe23849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.162829:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaab94c3/0xdd273c88cfe23849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.162854:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788796756.164938:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796756.164962:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaab94c3/0xdd273c88cfe23849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.164973:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031400 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796756.164978:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaab94c3/0xdd273c88cfe23849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.164987:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaab94c3/0xdd273c88cfe23849 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.165006:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaab94c3/0xdd273c88cfe23849 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.165015:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaab94c3/0xdd273c88cfe23849 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.165050:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796756.165052:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796756.165054:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788796756.168990:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.169008:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b5065a2/0xdd273c88cfe23850 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.169050:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.169055:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.169062:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b5065a2/0xdd273c88cfe23850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.169078:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b5065a2/0xdd273c88cfe23850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.169089:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b5065a2/0xdd273c88cfe23850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.169098:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b5065a2/0xdd273c88cfe23850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.169125:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788796756.169286:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796756.169295:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b5065a2/0xdd273c88cfe23850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.169303:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240030800 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796756.169309:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b5065a2/0xdd273c88cfe23850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.169331:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b5065a2/0xdd273c88cfe23850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.169349:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b5065a2/0xdd273c88cfe23850 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.169356:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b5065a2/0xdd273c88cfe23850 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.169383:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.169385:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.169387:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788796756.170533:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.170542:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4d42cd5/0xdd273c88cfe23857 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.170554:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.170558:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.170563:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d42cd5/0xdd273c88cfe23857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.170574:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4d42cd5/0xdd273c88cfe23857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.170594:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4d42cd5/0xdd273c88cfe23857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.170601:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d42cd5/0xdd273c88cfe23857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.170618:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788796756.171613:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.171621:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6600cf5/0xdd273c88cfe2385e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.171632:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.171635:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.171640:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6600cf5/0xdd273c88cfe2385e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.171650:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6600cf5/0xdd273c88cfe2385e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.171657:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6600cf5/0xdd273c88cfe2385e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.171664:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6600cf5/0xdd273c88cfe2385e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.171700:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788796756.172932:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788796756.172942:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4d42cd5/0xdd273c88cfe23857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.172951:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031000 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796756.172956:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d42cd5/0xdd273c88cfe23857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.172966:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d42cd5/0xdd273c88cfe23857 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.172984:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4d42cd5/0xdd273c88cfe23857 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.173003:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4d42cd5/0xdd273c88cfe23857 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.173026:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796756.173029:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6600cf5/0xdd273c88cfe2385e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.173035:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031a00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796756.173038:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6600cf5/0xdd273c88cfe2385e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.173054:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6600cf5/0xdd273c88cfe2385e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.173064:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6600cf5/0xdd273c88cfe2385e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.173072:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6600cf5/0xdd273c88cfe2385e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.173084:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.173085:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.173087:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796756.174251:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788796756.174549:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.174558:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9e6bc43/0xdd273c88cfe23865 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.174571:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.174575:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.174580:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9e6bc43/0xdd273c88cfe23865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.174592:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9e6bc43/0xdd273c88cfe23865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.174599:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9e6bc43/0xdd273c88cfe23865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.174606:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9e6bc43/0xdd273c88cfe23865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.175129:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788796756.176351:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.176361:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000269e1210/0xdd273c88cfe2386c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.176374:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.176387:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.176498:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000269e1210/0xdd273c88cfe2386c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.176513:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000269e1210/0xdd273c88cfe2386c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.176523:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000269e1210/0xdd273c88cfe2386c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.176530:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000269e1210/0xdd273c88cfe2386c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.187507:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788796756.187527:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9e6bc43/0xdd273c88cfe23865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.187560:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240030400 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796756.187565:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9e6bc43/0xdd273c88cfe23865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.187577:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9e6bc43/0xdd273c88cfe23865 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.187602:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9e6bc43/0xdd273c88cfe23865 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.187610:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9e6bc43/0xdd273c88cfe23865 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.187637:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796756.187641:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000269e1210/0xdd273c88cfe2386c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.187647:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240030e00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796756.187650:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000269e1210/0xdd273c88cfe2386c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.187656:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000269e1210/0xdd273c88cfe2386c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.187667:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000269e1210/0xdd273c88cfe2386c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796756.187683:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.187685:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.187687:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796756.192328:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788796756.192347:0:15054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000269e1210/0xdd273c88cfe2386c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.192482:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788796756.202002:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.202021:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8a12f75/0xdd273c88cfe23873 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.204183:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.204208:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.204219:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8a12f75/0xdd273c88cfe23873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.204240:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8a12f75/0xdd273c88cfe23873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.204263:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8a12f75/0xdd273c88cfe23873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.204271:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8a12f75/0xdd273c88cfe23873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.204294:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788796756.204969:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.204977:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008387b6c5/0xdd273c88cfe2387a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.204986:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.204990:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.204994:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008387b6c5/0xdd273c88cfe2387a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.205004:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008387b6c5/0xdd273c88cfe2387a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.205012:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008387b6c5/0xdd273c88cfe2387a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.205018:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008387b6c5/0xdd273c88cfe2387a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.205046:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788796756.205456:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.205463:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed13accf/0xdd273c88cfe23881 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.205471:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.205475:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.205479:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed13accf/0xdd273c88cfe23881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.205490:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed13accf/0xdd273c88cfe23881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.205498:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed13accf/0xdd273c88cfe23881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.205505:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed13accf/0xdd273c88cfe23881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.205513:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788796756.205951:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.205957:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e9d3052/0xdd273c88cfe23888 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.205966:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.205975:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.205980:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e9d3052/0xdd273c88cfe23888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.205989:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e9d3052/0xdd273c88cfe23888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.205997:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e9d3052/0xdd273c88cfe23888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.206004:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e9d3052/0xdd273c88cfe23888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.206011:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788796756.209164:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788796756.209180:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8a12f75/0xdd273c88cfe23873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209194:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031600 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796756.209209:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8a12f75/0xdd273c88cfe23873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209237:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8a12f75/0xdd273c88cfe23873 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209258:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8a12f75/0xdd273c88cfe23873 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209265:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8a12f75/0xdd273c88cfe23873 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209290:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788796756.209295:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008387b6c5/0xdd273c88cfe2387a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209302:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240030200 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796756.209305:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008387b6c5/0xdd273c88cfe2387a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209311:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008387b6c5/0xdd273c88cfe2387a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209320:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008387b6c5/0xdd273c88cfe2387a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209327:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008387b6c5/0xdd273c88cfe2387a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209355:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788796756.209360:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed13accf/0xdd273c88cfe23881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209366:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031800 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796756.209369:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed13accf/0xdd273c88cfe23881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209376:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed13accf/0xdd273c88cfe23881 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209399:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed13accf/0xdd273c88cfe23881 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209406:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed13accf/0xdd273c88cfe23881 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209418:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796756.209422:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e9d3052/0xdd273c88cfe23888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209429:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031e00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796756.209432:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e9d3052/0xdd273c88cfe23888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209451:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e9d3052/0xdd273c88cfe23888 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209463:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e9d3052/0xdd273c88cfe23888 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209470:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e9d3052/0xdd273c88cfe23888 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.209485:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796756.209487:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796756.209489:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796756.210151:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788796756.216317:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.216332:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cff2177f/0xdd273c88cfe2388f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.216351:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.216355:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.216362:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cff2177f/0xdd273c88cfe2388f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.216377:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cff2177f/0xdd273c88cfe2388f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.216387:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cff2177f/0xdd273c88cfe2388f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.216412:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cff2177f/0xdd273c88cfe2388f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.216439:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788796756.217300:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796756.217309:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cff2177f/0xdd273c88cfe2388f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.217319:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd141d5ba00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796756.217325:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cff2177f/0xdd273c88cfe2388f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.217335:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cff2177f/0xdd273c88cfe2388f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.217354:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cff2177f/0xdd273c88cfe2388f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.217377:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cff2177f/0xdd273c88cfe2388f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796756.217409:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796756.217412:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796756.217414:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788796756.217709:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.220341:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fb8b7d4/0xdd273c88cfe23896 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.220361:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.220367:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.220373:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fb8b7d4/0xdd273c88cfe23896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.220389:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fb8b7d4/0xdd273c88cfe23896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.220471:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fb8b7d4/0xdd273c88cfe23896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.220479:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fb8b7d4/0xdd273c88cfe23896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.220517:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788796756.222334:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796756.222349:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fb8b7d4/0xdd273c88cfe23896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.222363:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd141d5a400 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:1.0:1788796756.222380:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fb8b7d4/0xdd273c88cfe23896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.222400:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fb8b7d4/0xdd273c88cfe23896 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.222424:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fb8b7d4/0xdd273c88cfe23896 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.222432:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fb8b7d4/0xdd273c88cfe23896 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.222469:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796756.222472:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796756.222473:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788796756.227572:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788796756.227588:0:15054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e10937e8/0xdd273c88cfe2389d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.227624:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788796756.227628:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796756.227634:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e10937e8/0xdd273c88cfe2389d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.227650:0:15054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e10937e8/0xdd273c88cfe2389d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.227660:0:15054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e10937e8/0xdd273c88cfe2389d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.227668:0:15054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e10937e8/0xdd273c88cfe2389d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796756.227697:0:15054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788796756.228030:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796756.228038:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e10937e8/0xdd273c88cfe2389d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.228055:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd141d5b800 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:1.0:1788796756.228060:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e10937e8/0xdd273c88cfe2389d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.228069:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e10937e8/0xdd273c88cfe2389d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.228087:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e10937e8/0xdd273c88cfe2389d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.228093:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e10937e8/0xdd273c88cfe2389d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796756.228109:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796756.228111:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796756.228113:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788796756.228575:0:15054:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1788796756.228681:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14392:x1875688959344000:12345-0@lo:5:osp-pre-0-0.0 Request processed in 203327us (203511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796756.228694:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788796756.228960:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14392:1875688959344000:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788796756.228977:0:14392:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788796756.229034:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14392:1875688959344128:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788796756.229086:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796756.229145:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2459b9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796756.230335:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959344128 00000100:00100000:0.0:1788796756.230346:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959344128 00000100:00100000:0.0:1788796756.230401:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788796756.230411:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14392:x1875688959344128:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788796756.230454:0:15052:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788796756.270496:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14392:x1875688959344128:12345-0@lo:5:osp-pre-0-0.0 Request processed in 40077us (41401us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788796756.270510:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788796756.272484:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14392:1875688959344128:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788796756.272526:0:14392:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00080000:3.0:1788796756.488554:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788796756.488596:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788796756.702902:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796757.721915:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796758.746330:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796759.770933:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796760.794094:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788796761.425192:0:15767:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788796761.425198:0:15767:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788796761.425602:0:15767:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9bd249c10000 00000020:01000004:1.0:1788796761.425618:0:15767:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788796761.425632:0:15767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788796761.425646:0:15767:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bd246070000) 00000020:00000080:1.0:1788796761.425662:0:15767:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00000100:00100000:3.0:1788796761.440119:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959344256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796761.440195:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796761.440284:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959344256 00000100:00100000:3.0:1788796761.440310:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959344256 00000100:00100000:3.0:1788796761.440363:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788796761.440372:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959344256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788796761.440409:0:15056:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796761.440455:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959344256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796761.440462:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788796761.440482:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788796761.440510:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788796761.440541:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959344256:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788796761.442275:0:12649:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788796761.442282:0:12649:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788796761.442287:0:12649:0:(import.c:65:import_set_state_nolock()) ffff9bd27b4e5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788796761.442293:0:12649:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:0.0:1788796761.442299:0:12649:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788796761.442320:0:12649:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd27b4e5000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1788796761.442343:0:12649:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27e378700 x1875688959344512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788796761.442402:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959344512:0@lo:8:kworker.0 00000100:00100000:0.0:1788796761.442454:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796761.442496:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959344640:0@lo:400:kworker.0 00000100:00100000:0.0:1788796761.442523:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796761.442545:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788796761.442551:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959344768:0@lo:400:kworker.0 00000100:00100000:0.0:1788796761.442575:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796761.442605:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959344512 00000100:00100000:0.0:1788796761.442612:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959344512 00000100:00100000:0.0:1788796761.442643:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788796761.442649:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1875688959344512:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788796761.442667:0:15054:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788796761.444493:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3305:1875688959344384:0@lo:400:kworker.0 00000100:00100000:1.0:1788796761.444555:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796761.445000:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959344640 00000100:00100000:1.0:1788796761.445010:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959344640 00000100:00100000:1.0:1788796761.445054:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959344768 00000100:00100000:1.0:1788796761.445057:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959344768 00000100:00100000:1.0:1788796761.445081:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788796761.445088:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959344640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796761.445155:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959344640:12345-0@lo:400:kworker.0 Request processed in 67us (2631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796761.445162:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788796761.445179:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788796761.445185:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959344768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796761.445228:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875688959344768:12345-0@lo:400:kworker.0 Request processed in 43us (2652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796761.445233:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788796761.446200:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959344384 00000100:00100000:3.0:1788796761.446215:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959344384 00000100:00100000:3.0:1788796761.446252:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788796761.446260:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:3305:x1875688959344384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796761.446327:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:3305:x1875688959344384:12345-0@lo:400:kworker.0 Request processed in 68us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796761.446333:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788796761.446384:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3305:1875688959344384:0@lo:400:kworker.0 00000100:00080000:3.0:1788796761.446406:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788796761.456159:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27e379880 x1875688959344768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796761.456183:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875688959344768:0@lo:400:kworker.0 00010000:00080000:3.0:1788796761.456200:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27e379c00 x1875688959344640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796761.456211:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959344640:0@lo:400:kworker.0 00000100:00100000:3.0:1788796761.489600:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1875688959344512:12345-0@lo:8:kworker.0 Request processed in 46942us (47137us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788796761.489617:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788796761.494161:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd27b4e5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788796761.494173:0:3303:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788796761.494178:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959344512:0@lo:8:kworker.0 00100000:10000000:2.0:1788796761.495293:0:15767:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788796761.495665:0:15767:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788796761.497282:0:15767:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788796761.497654:0:15767:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788796761.498639:0:15767:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788796761.499599:0:15767:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 435: rc = 0 00100000:10000000:3.0:1788796761.499703:0:15767:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 435: rc = 0 00100000:10000000:3.0:1788796761.499832:0:15767:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 435: rc = 0 00100000:10000000:3.0:1788796761.500862:0:15767:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 535: rc = 0 00100000:10000000:3.0:1788796761.501427:0:15767:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 535: rc = 0 00100000:10000000:3.0:1788796761.501693:0:15767:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 535: rc = 0 00100000:10000000:3.0:1788796761.502238:0:15767:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 535: rc = 0 00100000:10000000:3.0:1788796761.502624:0:15767:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 535: rc = 0 00100000:10000000:3.0:1788796761.503137:0:15767:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 535: rc = 0 00000020:00000080:3.0:1788796761.504386:0:15767:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788796761.504401:0:15767:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788796761.504414:0:15767:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdd273c88cfe238ab 00000020:01000004:3.0:1788796761.504425:0:15767:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788796761.504450:0:15767:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.125@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788796761.504454:0:15767:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788796761.504460:0:15767:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788796761.504481:0:15767:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788796761.504484:0:15767:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788796761.524716:0:15767:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788796761.524780:0:15767:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.125@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788796761.524785:0:15767:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788796761.524787:0:15767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788796761.524788:0:15767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788796761.524789:0:15767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788796761.524791:0:15767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788796761.524792:0:15767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788796761.524793:0:15767:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788796761.524795:0:15767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788796761.524797:0:15767:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788796761.524801:0:15767:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788796761.524803:0:15767:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788796761.524805:0:15767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788796761.524806:0:15767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788796761.524807:0:15767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788796761.524808:0:15767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788796761.524809:0:15767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788796761.524810:0:15767:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788796761.524811:0:15767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788796761.524813:0:15767:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788796761.524855:0:15767:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788796761.524879:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959344896:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788796761.525036:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796761.525144:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2467e6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796761.525456:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959344896 00000100:00100000:0.0:1788796761.525465:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959344896 00000100:00100000:0.0:1788796761.525559:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788796761.525571:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15767:x1875688959344896:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788796761.525612:0:14364:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788796761.525616:0:14364:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788796761.525620:0:14364:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788796761.540189:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15767:x1875688959344896:12345-0@lo:253:mount.lustre.0 Request processed in 14610us (15142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796761.540207:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788796761.542926:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959344896:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788796761.542963:0:15767:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788796761.542967:0:15767:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788796761.542968:0:15767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788796761.542970:0:15767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788796761.542971:0:15767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788796761.542973:0:15767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788796761.542974:0:15767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788796761.542976:0:15767:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788796761.542977:0:15767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788796761.542979:0:15767:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788796761.543006:0:15767:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bd249c10000 from lustre-OST0001 10000000:01000000:3.0:1788796761.543037:0:15767:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788796761.543040:0:15767:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788796761.543048:0:15767:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bd2673e0000 local copy 00010000:00010000:3.0:1788796761.543058:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d21800/0xdd273c88cfe23658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2365f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796761.543547:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788796761.543606:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796761.543641:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a4ae540 going to sleep for 11 seconds 00000100:00100000:0.0:1788796761.543730:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959345024 00000100:00100000:0.0:1788796761.543738:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959345024 00000100:00100000:0.0:1788796761.543810:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788796761.543818:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15767:x1875688959345024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788796761.544417:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15767:x1875688959345024:12345-0@lo:501:mount.lustre.0 Request processed in 598us (809us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788796761.544426:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788796761.548739:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345024:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788796761.548794:0:15767:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788796761.549097:0:15767:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788796761.549118:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd247d21800/0xdd273c88cfe23658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2365f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796761.549129:0:15767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd247d21800/0xdd273c88cfe23658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2365f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796761.549166:0:15767:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bd249c10000 10000000:01000000:2.0:1788796761.549171:0:15767:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788796761.549178:0:15767:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788796761.549180:0:15767:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788796761.549192:0:15767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788796761.549195:0:15767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788796761.549239:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7400/0xdd273c88cfe238b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796761.549248:0:15767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7400/0xdd273c88cfe238b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796761.549260:0:15767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7400/0xdd273c88cfe238b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796761.549643:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345152:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788796761.549731:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796761.549868:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2671ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1788796761.552138:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959345152 00000100:00100000:0.0:1788796761.552154:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959345152 00000100:00100000:0.0:1788796761.552220:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788796761.552231:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:15767:x1875688959345152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788796761.552247:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796761.552269:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd141d5b000/0xdd273c88cfe238b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe238b2 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796761.552321:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd141d5b000/0xdd273c88cfe238b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe238b2 expref: 17 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796761.552334:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd141d5b000/0xdd273c88cfe238b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe238b2 expref: 17 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796761.552363:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5b000, rc 0) 00000100:00100000:0.0:1788796761.552442:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:15767:x1875688959345152:12345-0@lo:101:mount.lustre.0 Request processed in 213us (2710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796761.552450:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788796761.552663:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345152:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788796761.552680:0:15767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7400/0xdd273c88cfe238b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe238b9 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796761.552690:0:15767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7400/0xdd273c88cfe238b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe238b9 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788796761.553437:0:15767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788796761.554309:0:15767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788796761.554528:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788796761.554573:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788796761.554609:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788796761.554659:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788796761.554697:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788796761.554732:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788796761.554861:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788796761.554879:0:15767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788796761.554959:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788796761.555016:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796761.555053:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2671ed480 going to sleep for 11 seconds 00000100:00100000:1.0:1788796761.555701:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959345280 00000100:00100000:1.0:1788796761.555710:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959345280 00000100:00100000:1.0:1788796761.555789:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788796761.555799:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:15767:x1875688959345280:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788796761.556455:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:15767:x1875688959345280:12345-0@lo:501:mount.lustre.0 Request processed in 655us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796761.556464:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788796761.563684:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788796761.563786:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345408:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788796761.563871:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796761.563910:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a4ae540 going to sleep for 11 seconds 00000100:00100000:0.0:1788796761.564035:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959345408 00000100:00100000:0.0:1788796761.564044:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959345408 00000100:00100000:0.0:1788796761.564120:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788796761.564131:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:15767:x1875688959345408:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788796761.564547:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:15767:x1875688959345408:12345-0@lo:503:mount.lustre.0 Request processed in 416us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796761.564556:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788796761.564706:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345408:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788796761.565738:0:15767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788796761.565843:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788796761.565893:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796761.565925:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2671eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796761.566247:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959345536 00000100:00100000:0.0:1788796761.566257:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959345536 00000100:00100000:0.0:1788796761.566419:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788796761.566430:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:15767:x1875688959345536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788796761.566650:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:15767:x1875688959345536:12345-0@lo:502:mount.lustre.0 Request processed in 222us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796761.566658:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788796761.566862:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788796761.567088:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788796761.567150:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788796761.567187:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788796761.567254:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788796761.568144:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788796761.568200:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788796761.568263:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788796761.569441:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788796761.569526:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788796761.569583:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e378700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788796761.569667:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796761.569721:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2794a40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796761.571503:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959345664 00000100:00100000:2.0:1788796761.571518:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959345664 00000100:00100000:2.0:1788796761.571585:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788796761.571595:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:15767:x1875688959345664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788796761.571899:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:15767:x1875688959345664:12345-0@lo:502:mount.lustre.0 Request processed in 304us (2231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796761.571907:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788796761.572099:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e378700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788796761.572223:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788796761.572238:0:15767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788796761.584568:0:15769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788796761.584582:0:15769:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788796761.584590:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796761.584592:0:15769:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788796761.584601:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788796761.584617:0:15769:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9bd2466c99b8) 00000020:00000080:3.0:1788796761.584658:0:15769:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788796761.584665:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788796761.584733:0:15769:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd249c10000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788796761.584741:0:15769:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788796761.585047:0:15769:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdd273c88cfe238c7 00010000:00010000:3.0:1788796761.597914:0:15769:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788796761.600477:0:15769:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788796761.604997:0:15769:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788796761.609527:0:15769:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788796761.609541:0:15769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796761.609547:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796761.609549:0:15769:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788796761.609553:0:15769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796761.609571:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796761.609573:0:15769:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788796761.609576:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788796761.609578:0:15769:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788796761.609580:0:15769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796761.609583:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796761.609584:0:15769:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788796761.609587:0:15769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796761.609589:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796761.609590:0:15769:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788796761.609593:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788796761.609657:0:15769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796761.609661:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796761.609662:0:15769:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788796761.609665:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788796761.623357:0:15767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788796761.623416:0:15767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788796761.623444:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7400/0xdd273c88cfe238b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe238b9 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796761.623458:0:15767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd2466b7400/0xdd273c88cfe238b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe238b9 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796761.623480:0:15767:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd249c10000 from 1 10000000:01000000:1.0:1788796761.623484:0:15767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788796761.623529:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267335200/0xdd273c88cfe238ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796761.623537:0:15767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd267335200/0xdd273c88cfe238ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796761.623549:0:15767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd267335200/0xdd273c88cfe238ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796761.623600:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345792:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788796761.623674:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796761.623729:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27257c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796761.623844:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959345792 00000100:00100000:0.0:1788796761.623853:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959345792 00000100:00100000:0.0:1788796761.623909:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788796761.623922:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:15767:x1875688959345792:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788796761.623936:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796761.623958:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd141d5ac00/0xdd273c88cfe238d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe238ce expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796761.623986:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd141d5ac00/0xdd273c88cfe238d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe238ce expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796761.623999:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd141d5ac00/0xdd273c88cfe238d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe238ce expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796761.624008:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5ac00, rc 0) 00000100:00100000:0.0:1788796761.624053:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:15767:x1875688959345792:12345-0@lo:101:mount.lustre.0 Request processed in 134us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796761.624060:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788796761.624228:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345792:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788796761.624242:0:15767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd267335200/0xdd273c88cfe238ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe238d5 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796761.624252:0:15767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd267335200/0xdd273c88cfe238ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe238d5 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788796761.624780:0:15767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788796761.625131:0:15767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788796761.625363:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788796761.625408:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788796761.625476:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788796761.625484:0:15767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788796761.625539:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788796761.625580:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796761.625617:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27257c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796761.625849:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959345920 00000100:00100000:0.0:1788796761.625856:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959345920 00000100:00100000:0.0:1788796761.625890:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788796761.625899:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:15767:x1875688959345920:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788796761.626091:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:15767:x1875688959345920:12345-0@lo:501:mount.lustre.0 Request processed in 193us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796761.626121:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788796761.626258:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959345920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788796761.626346:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346048:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788796761.626391:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796761.626420:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27257c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796761.626656:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959346048 00000100:00100000:0.0:1788796761.626662:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959346048 00000100:00100000:0.0:1788796761.626694:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788796761.626702:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:15767:x1875688959346048:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788796761.627088:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:15767:x1875688959346048:12345-0@lo:503:mount.lustre.0 Request processed in 386us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796761.627096:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788796761.627184:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346048:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788796761.627709:0:15767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788796761.627809:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788796761.627852:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796761.627883:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27257c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796761.628330:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959346176 00000100:00100000:0.0:1788796761.628337:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959346176 00000100:00100000:0.0:1788796761.628373:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788796761.628381:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2630c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:15767:x1875688959346176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788796761.628578:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2630c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:15767:x1875688959346176:12345-0@lo:502:mount.lustre.0 Request processed in 197us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796761.628586:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788796761.628898:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788796761.629388:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788796761.629441:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788796761.629494:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788796761.629534:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788796761.629569:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788796761.629620:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788796761.629659:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788796761.629694:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788796761.629725:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346304:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788796761.630622:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796761.630659:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd27257c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788796761.631389:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959346304 00000100:00100000:0.0:1788796761.631399:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959346304 00000100:00100000:0.0:1788796761.631443:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788796761.631452:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2630c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:15767:x1875688959346304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788796761.631680:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2630c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:15767:x1875688959346304:12345-0@lo:502:mount.lustre.0 Request processed in 229us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796761.631688:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788796761.631798:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346304:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788796761.631919:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788796761.631935:0:15767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788796761.638659:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796761.638678:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796761.638680:0:15773:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788796761.638691:0:15773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd249c10000 00000020:00000080:2.0:1788796761.638693:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788796761.638701:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788796761.638704:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796761.638705:0:15773:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788796761.638708:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788796761.638710:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788796761.638711:0:15773:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788796761.638715:0:15773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bd249c10000 00000020:00000080:2.0:1788796761.638717:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788796761.642400:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796761.642429:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796761.642432:0:15773:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788796761.642437:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788796761.642442:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796761.642444:0:15773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788796761.642449:0:15773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bd249c10000 00000020:00000080:3.0:1788796761.642452:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788796761.642566:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788796761.642570:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788796761.642572:0:15773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788796761.642575:0:15773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788796761.649406:0:15767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788796761.649463:0:15767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788796761.649492:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267335200/0xdd273c88cfe238ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe238d5 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796761.649507:0:15767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd267335200/0xdd273c88cfe238ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe238d5 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796761.649565:0:15767:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788796761.649568:0:15767:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bd249c10000 10000000:01000000:1.0:1788796761.649571:0:15767:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bd249c10000 10000000:01000000:1.0:1788796761.649575:0:15767:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788796761.649581:0:15767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9bd249c10000 from 1 10000000:01000000:1.0:1788796761.649583:0:15767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788796761.649638:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267334a00/0xdd273c88cfe238dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796761.649646:0:15767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd267334a00/0xdd273c88cfe238dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796761.649660:0:15767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd267334a00/0xdd273c88cfe238dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796761.649686:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788796761.649776:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796761.649814:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2794e1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796761.649927:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959346432 00000100:00100000:3.0:1788796761.649935:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959346432 00000100:00100000:3.0:1788796761.649990:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788796761.649999:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2630c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:15767:x1875688959346432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788796761.650013:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796761.650026:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d20000/0xdd273c88cfe238e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe238dc expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.650048:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d20000/0xdd273c88cfe238e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe238dc expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.650059:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d20000/0xdd273c88cfe238e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe238dc expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.650075:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20000, rc 0) 00000100:00100000:3.0:1788796761.650127:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2630c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:15767:x1875688959346432:12345-0@lo:101:mount.lustre.0 Request processed in 128us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796761.650134:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788796761.654919:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788796761.654949:0:15767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd267334a00/0xdd273c88cfe238dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe238e3 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796761.654963:0:15767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd267334a00/0xdd273c88cfe238dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe238e3 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788796761.655622:0:15767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788796761.655979:0:15767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788796761.656245:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788796761.656288:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788796761.656323:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788796761.656369:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788796761.656404:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788796761.656463:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788796761.656499:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788796761.656530:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788796761.656573:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788796761.656619:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788796761.656649:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788796761.656698:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788796761.656732:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788796761.656789:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788796761.656838:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788796761.656872:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788796761.656903:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788796761.656948:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788796761.656984:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788796761.657014:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788796761.657054:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788796761.657112:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788796761.657148:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788796761.657194:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788796761.657226:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788796761.657254:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788796761.657311:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788796761.657348:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788796761.657379:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788796761.657424:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788796761.657460:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788796761.657493:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788796761.657528:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788796761.657573:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788796761.657608:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788796761.657656:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788796761.657692:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788796761.657812:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788796761.657820:0:15767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788796761.657920:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788796761.657986:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796761.658047:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959346560 00000100:00100000:1.0:1788796761.658055:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959346560 00000100:00100000:1.0:1788796761.658097:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788796761.663370:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2794e1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788796761.672282:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2630c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:15767:x1875688959346560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788796761.672626:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2630c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:15767:x1875688959346560:12345-0@lo:501:mount.lustre.0 Request processed in 14520us (14638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796761.672636:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788796761.672792:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788796761.672853:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346688:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788796761.672909:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796761.672948:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959346688 00000100:00100000:3.0:1788796761.672954:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959346688 00000100:00100000:3.0:1788796761.672997:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788796761.673005:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2630c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+20:15767:x1875688959346688:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788796761.673312:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2630c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+20:15767:x1875688959346688:12345-0@lo:503:mount.lustre.0 Request processed in 306us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796761.673320:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788796761.673370:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a533240 going to sleep for 11 seconds 00000100:00100000:3.0:1788796761.673383:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346688:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788796761.674000:0:15767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788796761.674068:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788796761.674123:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796761.674150:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959346816 00000100:00100000:3.0:1788796761.674154:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959346816 00000100:00100000:3.0:1788796761.674188:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788796761.674194:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2630c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+20:15767:x1875688959346816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788796761.674424:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2630c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+20:15767:x1875688959346816:12345-0@lo:502:mount.lustre.0 Request processed in 229us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796761.674438:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788796761.674556:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a533240 going to sleep for 11 seconds 00000100:00100000:3.0:1788796761.674571:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788796761.674844:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788796761.674894:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788796761.674927:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788796761.674976:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788796761.675015:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788796761.675065:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788796761.675111:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788796761.675146:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788796761.675186:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788796761.675215:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788796761.675243:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788796761.675284:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788796761.675321:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788796761.675368:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788796761.675418:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788796761.675455:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788796761.675492:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788796761.675537:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788796761.675574:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788796761.675607:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788796761.675658:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788796761.675694:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788796761.675729:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788796761.675838:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788796761.675878:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788796761.675913:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788796761.675962:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788796761.676012:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788796761.676047:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788796761.685707:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788796761.685939:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788796761.685980:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788796761.686016:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788796761.686083:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788796761.686138:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788796761.686220:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788796761.686263:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788796761.688823:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788796761.688980:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788796761.689022:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788796761.689079:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788796761.689181:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796761.689222:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959346944 00000100:00100000:3.0:1788796761.689231:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959346944 00000100:00100000:3.0:1788796761.689280:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788796761.691265:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2630c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:15767:x1875688959346944:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788796761.692065:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2630c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:15767:x1875688959346944:12345-0@lo:502:mount.lustre.0 Request processed in 2773us (2881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796761.692077:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788796761.692688:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a533240 going to sleep for 11 seconds 00000100:00100000:3.0:1788796761.692720:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959346944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788796761.692892:0:15767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788796761.692909:0:15767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788796761.697069:0:15778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788796761.697115:0:15778:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bd1423ccd28) 00000020:00000080:1.0:1788796761.697143:0:15778:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788796761.697230:0:15778:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bd249c10000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788796761.697234:0:15778:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bd249c10000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788796761.697236:0:15778:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bd249c10000 3 00010000:00080000:1.0:1788796761.697266:0:15778:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bd1423d7800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.125@tcp at head 00010000:00010000:1.0:1788796761.701416:0:15778:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788796761.701727:0:15778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788796761.701838:0:15778:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788796761.701853:0:15778:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdd273c88cfe238f1 00000100:00080000:1.0:1788796761.701865:0:15778:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788796761.701878:0:15778:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bd1423d7800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1788796761.701918:0:15778:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd27e3c8e00 x1875688959347072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788796761.701979:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875688959347072:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788796761.702058:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788796761.702713:0:15778:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788796761.704325:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959347072 00000100:00100000:3.0:1788796761.704342:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959347072 00000100:00100000:3.0:1788796761.704390:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788796761.704400:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875688959347072:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788796761.704438:0:14371:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:3.0:1788796761.704478:0:14371:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdd273c88cfe238f8 00000004:00100000:3.0:1788796761.704498:0:14371:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788796761.704534:0:14371:0:(import.c:65:import_set_state_nolock()) ffff9bd247d4e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788796761.704614:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875688959347072:12345-0@lo:38:llog_process_th.0 Request processed in 214us (2555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796761.704623:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788796761.709603:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bd27e3c8e00 x1875688959347072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788796771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796761.709622:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788796761.709634:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788796761.709990:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788796761.709997:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788796761.710001:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd1423d7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788796761.710010:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875688959347072:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788796761.711505:0:15778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788796761.711791:0:15767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788796761.711829:0:15767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788796761.711844:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd267334a00/0xdd273c88cfe238dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe238e3 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796761.711857:0:15767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd267334a00/0xdd273c88cfe238dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe238e3 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788796761.711907:0:15767:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788796761.711910:0:15767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788796761.711911:0:15767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796761.711913:0:15767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796761.711914:0:15767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796761.711915:0:15767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796761.711917:0:15767:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788796761.711919:0:15767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796761.711921:0:15767:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788796761.711924:0:15767:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788796761.711927:0:15767:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788796761.711928:0:15767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788796761.711930:0:15767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796761.711931:0:15767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796761.711932:0:15767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796761.711933:0:15767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796761.711934:0:15767:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788796761.711935:0:15767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796761.711936:0:15767:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788796761.711961:0:15767:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788796761.711980:0:15767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959347200:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788796761.712052:0:15767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796761.712099:0:15767:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24d980780 going to sleep for 11 seconds 00000100:00100000:0.0:1788796761.716503:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959347200 00000100:00100000:0.0:1788796761.716521:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959347200 00000100:00100000:0.0:1788796761.716590:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788796761.716602:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:15767:x1875688959347200:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788796761.716659:0:14363:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788796761.716674:0:14363:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788796761.766266:0:14363:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788796761.766281:0:14363:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788796761.766326:0:14385:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788796761.766331:0:14385:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788796761.766357:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe238ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.766382:0:14385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd267335400/0xdd273c88cfe237d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe237d2 expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.766409:0:14385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe238ff lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.766454:0:14385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd267335400/0xdd273c88cfe237d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe237d2 expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.766470:0:14385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd267335400/0xdd273c88cfe237d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe237d2 expref: 19 pid: 14363 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796761.766486:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267998380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14385:1875688959347328:0@lo:104: 00000100:00100000:3.0:1788796761.766549:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796761.766588:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a5336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788796761.766627:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959347328 00000100:00100000:3.0:1788796761.766634:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959347328 00000100:00100000:3.0:1788796761.766984:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788796761.766994:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+3:14385:x1875688959347328:12345-0@lo:104: 00010000:00010000:3.0:1788796761.767008:0:14352:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd247d20800/0xdd273c88cfe237d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe237d9 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.767070:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788796761.767077:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+3:14385:x1875688959347328:12345-0@lo:104: Request processed in 85us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796761.767084:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788796761.767175:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267998380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14385:1875688959347328:0@lo:104: 00010000:00010000:0.0:1788796761.767194:0:14385:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe238ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.776616:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796761.776632:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd247d20800/0xdd273c88cfe237d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe237d9 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.776656:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20800 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:3.0:1788796761.776675:0:14358:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd247d20800/0xdd273c88cfe237d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe237d9 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.776687:0:14358:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd247d20800/0xdd273c88cfe237d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe237d9 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788796761.776694:0:14358:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd247d20800/0xdd273c88cfe237d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe237d9 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796761.776700:0:14358:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788796761.776785:0:14358:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd247d20800/0xdd273c88cfe237d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe237d9 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.776792:0:14358:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788796761.776819:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd247d20800/0xdd273c88cfe237d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe237d9 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.776827:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd247d20800/0xdd273c88cfe237d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe237d9 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.776845:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796761.776847:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796761.776849:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796761.776857:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796761.776878:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3305:1875688959347456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788796761.776957:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796761.777019:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959347456 00000100:00100000:3.0:1788796761.777026:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959347456 00010000:00010000:3.0:1788796761.777055:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd267335400/0xdd273c88cfe237d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe237d2 expref: 20 pid: 14363 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796761.777110:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788796761.777122:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+20:3305:x1875688959347456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788796761.777136:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796761.777141:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd267335400/0xdd273c88cfe237d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe237d2 expref: 20 pid: 14363 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.777152:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd267335400/0xdd273c88cfe237d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe237d2 expref: 20 pid: 14363 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.777180:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd267335400/0xdd273c88cfe237d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe237d2 expref: 20 pid: 14363 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.777195:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe238ff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.777204:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe238ff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788796761.777221:0:14354:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015982558s 00010000:00010000:3.0:1788796761.777225:0:14354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe238ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.777232:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe238ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.777238:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe238ff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.777245:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe238ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.777257:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20c00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796761.777262:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe238ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.777269:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe238ff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.777283:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe238ff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.777293:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796761.777330:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:3305:x1875688959347456:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796761.777352:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788796761.777395:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3305:1875688959347456:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788796761.777421:0:14385:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe238ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.777429:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe238ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796761.777435:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe238ff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796761.786833:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:15767:x1875688959347200:12345-0@lo:253:mount.lustre.0 Request processed in 70223us (74769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796761.786852:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788796761.792382:0:15767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cc080b8f-c449-46a7-a564-69e1c33bc9a6:15767:1875688959347200:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788796761.792406:0:15767:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788796761.792410:0:15767:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788796761.792411:0:15767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788796761.792431:0:15767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788796761.792433:0:15767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788796761.792434:0:15767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788796761.792436:0:15767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788796761.792437:0:15767:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788796761.792439:0:15767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788796761.792440:0:15767:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788796761.792458:0:15767:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788796761.798258:0:15767:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796761.798434:0:15767:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788796761.798598:0:15767:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796761.799054:0:15767:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788796761.799612:0:15767:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788796761.801913:0:15767:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788796761.810545:0:15767:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1788796761.854977:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788796761.991568:0:15767:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788796761.991579:0:15767:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788796761.991615:0:15767:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788796761.991677:0:15767:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788796761.991695:0:15767:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788796761.991725:0:15767:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000040:00080000:2.0:1788796762.353141:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788796762.844864:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788796763.738586:0:14367:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788796763.738595:0:14367:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9bd27e170800 from 8 10000000:01000000:0.0:1788796763.738600:0:14367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788796763.738644:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd141d5a200/0xdd273c88cfe23906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796763.738656:0:14367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd141d5a200/0xdd273c88cfe23906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796763.738667:0:14367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd141d5a200/0xdd273c88cfe23906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796763.738694:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e378700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959347584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788796763.740041:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796763.740102:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd249b31c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796763.749076:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959347584 00000100:00100000:3.0:1788796763.749098:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959347584 00000100:00100000:3.0:1788796763.749168:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788796763.749180:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:14367:x1875688959347584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796763.749213:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796763.749232:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe2390d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe23906 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796763.749260:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe2390d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe23906 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796763.749272:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd247d20c00/0xdd273c88cfe2390d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe23906 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796763.749282:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20c00, rc 0) 00000100:00100000:3.0:1788796763.749360:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:14367:x1875688959347584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (9323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796763.749368:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788796763.749423:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e378700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959347584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796763.749442:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd141d5a200/0xdd273c88cfe23906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2390d expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796763.749452:0:14367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd141d5a200/0xdd273c88cfe23906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe2390d expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796763.749512:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959347712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788796763.749551:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796763.749575:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd24a533240 going to sleep for 11 seconds 00000100:00100000:0.0:1788796763.751679:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959347712 00000100:00100000:0.0:1788796763.751693:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959347712 00000100:00100000:0.0:1788796763.751776:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788796763.751788:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:14367:x1875688959347712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788796763.751829:0:14364:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788796763.751847:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788796763.751850:0:14364:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788796763.752105:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:14367:x1875688959347712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 319us (2552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796763.752113:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788796763.752143:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959347712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788796763.752232:0:14367:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788796763.752243:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd141d5a200/0xdd273c88cfe23906 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2390d expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796763.752254:0:14367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd141d5a200/0xdd273c88cfe23906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe2390d expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796763.865908:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796764.901294:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796765.914806:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796766.556603:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959347840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788796766.556677:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796766.556764:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959347840 00000100:00100000:0.0:1788796766.556773:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959347840 00000100:00080000:3.0:1788796766.556816:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796766.556845:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788796766.556855:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959347840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796766.556904:0:15056:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796766.556972:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959347840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796766.556980:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788796766.557003:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959347840:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788796766.938802:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788796767.069829:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788796767.069838:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788796767.069843:0:8:0:(import.c:65:import_set_state_nolock()) ffff9bd27b4e5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788796767.069863:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:3.0:1788796767.069868:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788796767.069880:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bd27b4e5000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:3.0:1788796767.069900:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bd26799ad80 x1875688959348224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788796767.069968:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959348096:0@lo:400:kworker.0 00000100:00100000:3.0:1788796767.070051:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796767.070098:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959348352:0@lo:400:kworker.0 00000100:00100000:3.0:1788796767.070112:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788796767.070118:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3307:1875688959347968:0@lo:400:kworker.0 00000100:00100000:1.0:1788796767.070136:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796767.070146:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796767.070156:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788796767.070162:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959348480:0@lo:400:kworker.0 00000100:00100000:3.0:1788796767.070165:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959348608:0@lo:400:kworker.0 00000100:00100000:3.0:1788796767.070185:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796767.070192:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959348224:0@lo:8:kworker.0 00000100:00100000:1.0:1788796767.070218:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796767.070221:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959348096 00000100:00100000:3.0:1788796767.070229:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959348096 00000100:00100000:1.0:1788796767.070252:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959347968 00000100:00100000:1.0:1788796767.070255:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959347968 00000100:00100000:3.0:1788796767.070266:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959348224 00000100:00100000:3.0:1788796767.070268:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959348224 00000100:00100000:3.0:1788796767.070280:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788796767.070281:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788796767.070289:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959348096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796767.070289:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:3307:x1875688959347968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796767.070340:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:3307:x1875688959347968:12345-0@lo:400:kworker.0 Request processed in 51us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796767.070348:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788796767.070381:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959348352 00000100:00100000:1.0:1788796767.070385:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959348352 00000100:00100000:1.0:1788796767.070407:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959348608 00000100:00100000:1.0:1788796767.070410:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959348608 00000100:00100000:1.0:1788796767.070450:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788796767.070455:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959348352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796767.070484:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959348352:12345-0@lo:400:kworker.0 Request processed in 29us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796767.070491:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788796767.070502:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788796767.070508:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959348608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796767.073182:0:15052:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788796767.073204:0:15052:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788796767.073222:0:15054:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788796767.073235:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788796767.073244:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1875688959348224:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788796767.073279:0:15054:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:2.0:1788796767.073310:0:15054:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdd273c88cfe23914 00002000:00100000:2.0:1788796767.073325:0:15054:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bd141160000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788796767.073330:0:15054:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788796767.073333:0:15054:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788796767.073470:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959348096:12345-0@lo:400:kworker.0 Request processed in 3180us (3417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796767.073489:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788796767.073591:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796767.073627:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3307:1875688959347968:0@lo:400:kworker.0 00002000:00080000:2.0:1788796767.073666:0:15054:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788796767.073692:0:15054:0:(import.c:65:import_set_state_nolock()) ffff9bd141166800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788796767.073778:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875688959348224:12345-0@lo:8:kworker.0 Request processed in 533us (3558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796767.073794:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788796767.073925:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788796767.073969:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267999500 x1875688959348352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796767.073981:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959348352:0@lo:400:kworker.0 00000100:00100000:2.0:1788796767.074109:0:14369:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788796767.074116:0:14369:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788796767.074190:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959348480 00000100:00100000:2.0:1788796767.074197:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959348480 00000100:00100000:2.0:1788796767.074232:0:14369:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788796767.074240:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788796767.074246:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959348480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796767.074287:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959348480:12345-0@lo:400:kworker.0 Request processed in 41us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796767.074293:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788796767.074319:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd267998700 x1875688959348480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796767.074330:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959348480:0@lo:400:kworker.0 00000100:00080000:2.0:1788796767.074430:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788796767.074586:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd26799ad80 x1875688959348224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788796792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788796767.074595:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788796767.074602:0:3303:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788796767.074610:0:3303:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788796767.074614:0:3303:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788796767.074623:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9bd27b4e5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788796767.074635:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788796767.074640:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd26799ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875688959348224:0@lo:8:kworker.0 00000004:00080000:2.0:1788796767.074690:0:14394:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788796767.074708:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14394:1875688959348864:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788796767.074774:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796767.074792:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd243f7af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796767.074802:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788796767.074809:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959348736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788796767.074834:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796767.074865:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959348864 00000100:00100000:2.0:1788796767.074870:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959348864 00000100:00100000:2.0:1788796767.074898:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788796767.074905:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14394:x1875688959348864:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788796767.078800:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959348608:12345-0@lo:400:kworker.0 Request processed in 8281us (8602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796767.078817:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000004:00080000:0.0:1788796767.079965:0:14393:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788796767.081091:0:14393:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 494062342956ns, next at 0ns, rc = 0 00010000:00080000:3.0:1788796767.092967:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27e3aa300 x1875688959348608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796767.092990:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959348608:0@lo:400:kworker.0 00000100:00100000:3.0:1788796767.093085:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959348736 00000100:00100000:3.0:1788796767.093092:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959348736 00000100:00100000:3.0:1788796767.093137:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788796767.093146:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959348736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788796767.093183:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796767.093267:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959348736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (18431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796767.093274:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788796767.093416:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27b4f9c00 x1875688959348736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788796783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796767.093433:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959348736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796767.093463:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959348096:0@lo:400:kworker.0 00000100:00080000:3.0:1788796767.093499:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1788796767.093976:0:15055:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788796767.093986:0:15055:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788796767.093992:0:15055:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1788796767.116365:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788796767.116378:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe2391b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.116396:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1788796767.116400:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796767.116406:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe2391b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.116423:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe2391b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.116441:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe2391b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.116449:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe2391b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.116464:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788796767.117204:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788796767.117212:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe23922 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117223:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1788796767.117226:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796767.117231:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe23922 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117242:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe23922 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117250:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe23922 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117258:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe23922 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117285:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788796767.117297:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788796767.117303:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe2391b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117312:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7c00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.117317:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe2391b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117327:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe2391b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117345:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe2391b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117353:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe2391b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117370:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796767.117374:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe23922 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117382:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7a00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.117385:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe23922 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117404:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe23922 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117415:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe23922 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117423:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe23922 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117435:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.117436:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.117438:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788796767.117876:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788796767.117882:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23929 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117891:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1788796767.117894:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796767.117899:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117908:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117917:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117930:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117941:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788796767.117950:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796767.117953:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117960:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6600 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.117964:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117972:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23929 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117983:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23929 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.117991:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23929 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.118003:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.118004:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796767.118446:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788796767.118969:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788796767.118979:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e80e627e/0xdd273c88cfe23930 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.118992:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788796767.118996:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796767.119001:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e80e627e/0xdd273c88cfe23930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.119026:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e80e627e/0xdd273c88cfe23930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.119037:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e80e627e/0xdd273c88cfe23930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.119045:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e80e627e/0xdd273c88cfe23930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.119075:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788796767.119559:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788796767.119566:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c3616f4/0xdd273c88cfe23937 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.119575:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788796767.119578:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796767.119582:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c3616f4/0xdd273c88cfe23937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.119592:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c3616f4/0xdd273c88cfe23937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.119600:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c3616f4/0xdd273c88cfe23937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.119607:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c3616f4/0xdd273c88cfe23937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.119615:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788796767.119995:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788796767.120001:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbcd8557/0xdd273c88cfe2393e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.120024:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788796767.120033:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796767.120038:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbcd8557/0xdd273c88cfe2393e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.120048:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbcd8557/0xdd273c88cfe2393e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.120056:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbcd8557/0xdd273c88cfe2393e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.120062:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbcd8557/0xdd273c88cfe2393e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.120070:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788796767.120451:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788796767.120457:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000afa0a33/0xdd273c88cfe23945 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.120465:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788796767.120468:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796767.120472:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000afa0a33/0xdd273c88cfe23945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.120480:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000afa0a33/0xdd273c88cfe23945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.120489:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000afa0a33/0xdd273c88cfe23945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.120501:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000afa0a33/0xdd273c88cfe23945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.120510:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788796767.120926:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788796767.120932:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029c15bc5/0xdd273c88cfe2394c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.120941:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788796767.120945:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796767.120949:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029c15bc5/0xdd273c88cfe2394c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.120958:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029c15bc5/0xdd273c88cfe2394c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.120965:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029c15bc5/0xdd273c88cfe2394c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.120971:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029c15bc5/0xdd273c88cfe2394c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.120980:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788796767.121372:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788796767.121379:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002dfc11b/0xdd273c88cfe23953 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.121392:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788796767.121395:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796767.121400:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002dfc11b/0xdd273c88cfe23953 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.121409:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002dfc11b/0xdd273c88cfe23953 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.121418:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002dfc11b/0xdd273c88cfe23953 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.121424:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002dfc11b/0xdd273c88cfe23953 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.121431:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788796767.121867:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788796767.121873:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd730d07/0xdd273c88cfe2395a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.121881:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788796767.121884:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796767.121888:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd730d07/0xdd273c88cfe2395a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.121898:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd730d07/0xdd273c88cfe2395a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.121916:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd730d07/0xdd273c88cfe2395a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.121923:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd730d07/0xdd273c88cfe2395a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.121930:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1788796767.122543:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788796767.122552:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e80e627e/0xdd273c88cfe23930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122562:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335000 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796767.122567:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e80e627e/0xdd273c88cfe23930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122578:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e80e627e/0xdd273c88cfe23930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122609:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e80e627e/0xdd273c88cfe23930 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122617:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e80e627e/0xdd273c88cfe23930 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122642:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788796767.122646:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c3616f4/0xdd273c88cfe23937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122652:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334400 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796767.122655:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c3616f4/0xdd273c88cfe23937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122662:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c3616f4/0xdd273c88cfe23937 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122671:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c3616f4/0xdd273c88cfe23937 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122677:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c3616f4/0xdd273c88cfe23937 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122689:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788796767.122692:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbcd8557/0xdd273c88cfe2393e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122704:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335800 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796767.122707:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbcd8557/0xdd273c88cfe2393e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122714:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbcd8557/0xdd273c88cfe2393e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122724:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbcd8557/0xdd273c88cfe2393e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122731:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbcd8557/0xdd273c88cfe2393e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122760:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788796767.122764:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000afa0a33/0xdd273c88cfe23945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122771:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335600 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796767.122774:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000afa0a33/0xdd273c88cfe23945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122781:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000afa0a33/0xdd273c88cfe23945 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122792:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000afa0a33/0xdd273c88cfe23945 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122805:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000afa0a33/0xdd273c88cfe23945 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122821:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788796767.122824:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029c15bc5/0xdd273c88cfe2394c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122831:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334e00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796767.122834:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029c15bc5/0xdd273c88cfe2394c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122841:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029c15bc5/0xdd273c88cfe2394c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122859:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029c15bc5/0xdd273c88cfe2394c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122867:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029c15bc5/0xdd273c88cfe2394c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122879:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788796767.122883:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002dfc11b/0xdd273c88cfe23953 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122889:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334600 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796767.122899:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002dfc11b/0xdd273c88cfe23953 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122907:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002dfc11b/0xdd273c88cfe23953 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122917:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002dfc11b/0xdd273c88cfe23953 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122923:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002dfc11b/0xdd273c88cfe23953 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122935:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788796767.122938:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd730d07/0xdd273c88cfe2395a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122945:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334c00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796767.122947:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd730d07/0xdd273c88cfe2395a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122954:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd730d07/0xdd273c88cfe2395a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122962:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd730d07/0xdd273c88cfe2395a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122968:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd730d07/0xdd273c88cfe2395a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796767.122989:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796767.122990:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788796767.122993:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.129415:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788796767.132168:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788796767.132183:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc69ae42/0xdd273c88cfe23961 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.132202:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788796767.132206:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796767.132213:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc69ae42/0xdd273c88cfe23961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.132229:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc69ae42/0xdd273c88cfe23961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.132240:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc69ae42/0xdd273c88cfe23961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.132248:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc69ae42/0xdd273c88cfe23961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.132283:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788796767.132310:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796767.132316:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc69ae42/0xdd273c88cfe23961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.132325:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335a00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:1.0:1788796767.132330:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc69ae42/0xdd273c88cfe23961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.132340:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc69ae42/0xdd273c88cfe23961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.132357:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc69ae42/0xdd273c88cfe23961 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.132366:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc69ae42/0xdd273c88cfe23961 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.132386:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796767.132388:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796767.132390:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788796767.134376:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788796767.134391:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9c73df3/0xdd273c88cfe23968 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.134408:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788796767.134421:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796767.134427:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9c73df3/0xdd273c88cfe23968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.134442:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9c73df3/0xdd273c88cfe23968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.134453:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9c73df3/0xdd273c88cfe23968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.134461:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9c73df3/0xdd273c88cfe23968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.134480:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788796767.136677:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788796767.136691:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc40d78a/0xdd273c88cfe2396f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.136708:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788796767.136712:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796767.136718:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc40d78a/0xdd273c88cfe2396f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.136732:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc40d78a/0xdd273c88cfe2396f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.136743:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc40d78a/0xdd273c88cfe2396f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.136770:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc40d78a/0xdd273c88cfe2396f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.136786:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788796767.136798:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788796767.136804:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9c73df3/0xdd273c88cfe23968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.136812:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335400 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:1.0:1788796767.136817:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9c73df3/0xdd273c88cfe23968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.136826:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9c73df3/0xdd273c88cfe23968 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.136844:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9c73df3/0xdd273c88cfe23968 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.138419:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9c73df3/0xdd273c88cfe23968 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.138570:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796767.138576:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc40d78a/0xdd273c88cfe2396f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.138596:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335c00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:1.0:1788796767.138601:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc40d78a/0xdd273c88cfe2396f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.138611:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc40d78a/0xdd273c88cfe2396f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.138628:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc40d78a/0xdd273c88cfe2396f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.138635:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc40d78a/0xdd273c88cfe2396f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.138646:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796767.138648:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796767.138650:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.142076:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788796767.150969:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788796767.150987:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed50cbd4/0xdd273c88cfe23976 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.151016:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788796767.151021:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796767.151028:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed50cbd4/0xdd273c88cfe23976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.151043:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed50cbd4/0xdd273c88cfe23976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.151060:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed50cbd4/0xdd273c88cfe23976 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.151068:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed50cbd4/0xdd273c88cfe23976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.151087:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788796767.151103:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796767.151109:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed50cbd4/0xdd273c88cfe23976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.151116:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316b800 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:1.0:1788796767.151121:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed50cbd4/0xdd273c88cfe23976 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.151129:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed50cbd4/0xdd273c88cfe23976 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.151146:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed50cbd4/0xdd273c88cfe23976 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.151153:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed50cbd4/0xdd273c88cfe23976 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.151170:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796767.151177:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796767.151179:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788796767.152982:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788796767.152994:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e6b98c3/0xdd273c88cfe2397d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.153020:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788796767.153025:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796767.153031:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e6b98c3/0xdd273c88cfe2397d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.153045:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e6b98c3/0xdd273c88cfe2397d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.153055:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e6b98c3/0xdd273c88cfe2397d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.153063:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e6b98c3/0xdd273c88cfe2397d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.153085:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788796767.154213:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788796767.154222:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bb07b8f/0xdd273c88cfe23984 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.154234:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1788796767.154238:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796767.154243:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bb07b8f/0xdd273c88cfe23984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.154262:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bb07b8f/0xdd273c88cfe23984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.154271:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bb07b8f/0xdd273c88cfe23984 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.154278:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bb07b8f/0xdd273c88cfe23984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.154830:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788796767.156453:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788796767.156468:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e6b98c3/0xdd273c88cfe2397d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.156481:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316b600 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.156485:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e6b98c3/0xdd273c88cfe2397d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.156496:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e6b98c3/0xdd273c88cfe2397d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.156514:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e6b98c3/0xdd273c88cfe2397d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.156521:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e6b98c3/0xdd273c88cfe2397d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.156739:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796767.156758:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bb07b8f/0xdd273c88cfe23984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.156766:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316a800 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.156769:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bb07b8f/0xdd273c88cfe23984 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.156777:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bb07b8f/0xdd273c88cfe23984 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.156800:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bb07b8f/0xdd273c88cfe23984 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.156808:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bb07b8f/0xdd273c88cfe23984 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.156822:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.156824:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.156826:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796767.165721:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788796767.167289:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788796767.167303:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a86bbc4/0xdd273c88cfe2398b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.167320:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1788796767.167331:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796767.167338:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a86bbc4/0xdd273c88cfe2398b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.170622:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a86bbc4/0xdd273c88cfe2398b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.170636:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a86bbc4/0xdd273c88cfe2398b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.170643:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a86bbc4/0xdd273c88cfe2398b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.170660:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788796767.171281:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788796767.171289:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d60f9746/0xdd273c88cfe23992 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.171302:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1788796767.171307:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796767.171313:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d60f9746/0xdd273c88cfe23992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.171323:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d60f9746/0xdd273c88cfe23992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.171331:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d60f9746/0xdd273c88cfe23992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.171346:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d60f9746/0xdd273c88cfe23992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.171364:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788796767.172783:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788796767.172794:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a86bbc4/0xdd273c88cfe2398b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.172806:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20800 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.172810:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a86bbc4/0xdd273c88cfe2398b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.172820:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a86bbc4/0xdd273c88cfe2398b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.172840:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a86bbc4/0xdd273c88cfe2398b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.172861:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a86bbc4/0xdd273c88cfe2398b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.172893:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796767.172898:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d60f9746/0xdd273c88cfe23992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.172905:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20600 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.172908:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d60f9746/0xdd273c88cfe23992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.172916:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d60f9746/0xdd273c88cfe23992 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.172928:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d60f9746/0xdd273c88cfe23992 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.172936:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d60f9746/0xdd273c88cfe23992 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.172948:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.172950:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.172952:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796767.173081:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788796767.177431:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788796767.177445:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23999 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.177462:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1788796767.177473:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796767.177480:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.177496:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.177507:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.177515:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.177910:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788796767.177923:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796767.177929:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.177938:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6600 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.177943:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.177952:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23999 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.177969:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23999 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.177987:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1825969/0xdd273c88cfe23999 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.178003:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.178015:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.178017:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788796767.183039:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788796767.183058:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f886893e/0xdd273c88cfe239a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.183078:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1788796767.183084:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796767.183090:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f886893e/0xdd273c88cfe239a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.183107:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f886893e/0xdd273c88cfe239a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.183118:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f886893e/0xdd273c88cfe239a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.183127:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f886893e/0xdd273c88cfe239a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.183149:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788796767.186137:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788796767.186150:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8ba085a/0xdd273c88cfe239a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.186175:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1788796767.186179:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796767.186185:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ba085a/0xdd273c88cfe239a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.186199:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8ba085a/0xdd273c88cfe239a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.186209:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8ba085a/0xdd273c88cfe239a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.186216:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ba085a/0xdd273c88cfe239a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.186235:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788796767.186312:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788796767.186321:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f886893e/0xdd273c88cfe239a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.186329:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20a00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.186334:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f886893e/0xdd273c88cfe239a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.186344:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f886893e/0xdd273c88cfe239a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.186362:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f886893e/0xdd273c88cfe239a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.186369:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f886893e/0xdd273c88cfe239a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.186389:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796767.186393:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8ba085a/0xdd273c88cfe239a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.186406:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21c00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.186410:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8ba085a/0xdd273c88cfe239a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.186417:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8ba085a/0xdd273c88cfe239a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.186427:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8ba085a/0xdd273c88cfe239a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.186434:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8ba085a/0xdd273c88cfe239a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.186448:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.186450:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.186451:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788796767.189636:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788796767.189813:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788796767.192982:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788796767.192995:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe239ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.193025:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1788796767.193029:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796767.193035:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe239ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.193051:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe239ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.193067:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe239ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.193074:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe239ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.193100:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788796767.195001:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796767.195026:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe239ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.195039:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21200 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.195044:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe239ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.195055:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe239ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.195088:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe239ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.195095:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000059be139/0xdd273c88cfe239ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.195119:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.195121:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.195123:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788796767.197917:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788796767.197932:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1a89b88/0xdd273c88cfe239b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.197949:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1788796767.197954:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796767.197960:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1a89b88/0xdd273c88cfe239b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.197976:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1a89b88/0xdd273c88cfe239b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.197986:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1a89b88/0xdd273c88cfe239b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.197994:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1a89b88/0xdd273c88cfe239b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.198039:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788796767.198059:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788796767.198066:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1a89b88/0xdd273c88cfe239b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.198075:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21400 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:1.0:1788796767.198079:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1a89b88/0xdd273c88cfe239b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.198089:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1a89b88/0xdd273c88cfe239b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.198107:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1a89b88/0xdd273c88cfe239b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.198120:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1a89b88/0xdd273c88cfe239b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796767.198136:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796767.198138:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796767.198140:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788796767.202967:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788796767.202985:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e9d3052/0xdd273c88cfe239bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.203038:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1788796767.203043:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796767.203049:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e9d3052/0xdd273c88cfe239bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.203063:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e9d3052/0xdd273c88cfe239bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.203073:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e9d3052/0xdd273c88cfe239bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.203080:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e9d3052/0xdd273c88cfe239bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796767.203105:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788796767.203159:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796767.203168:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e9d3052/0xdd273c88cfe239bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.203177:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031e00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.203182:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e9d3052/0xdd273c88cfe239bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.203191:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e9d3052/0xdd273c88cfe239bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.203206:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e9d3052/0xdd273c88cfe239bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.203212:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e9d3052/0xdd273c88cfe239bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.203244:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.203246:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.203248:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788796767.206106:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788796767.206119:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe239c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206137:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1788796767.206142:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796767.206148:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe239c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206163:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe239c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206174:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe239c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206184:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe239c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206214:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788796767.206644:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788796767.206650:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe239ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206669:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1788796767.206672:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796767.206677:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe239ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206686:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe239ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206695:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe239ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206702:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe239ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206720:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788796767.206731:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788796767.206737:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe239c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206778:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7a00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.206783:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe239c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206792:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe239c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206819:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe239c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206827:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043069e5b/0xdd273c88cfe239c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206843:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796767.206856:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe239ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206863:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7c00 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.206866:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe239ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206874:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe239ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206884:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe239ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206891:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004997a593/0xdd273c88cfe239ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.206902:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.206904:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.206911:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788796767.207307:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788796767.207313:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d34fd9ad/0xdd273c88cfe239d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207322:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1788796767.207325:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796767.207329:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d34fd9ad/0xdd273c88cfe239d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207338:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d34fd9ad/0xdd273c88cfe239d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207346:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d34fd9ad/0xdd273c88cfe239d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207353:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d34fd9ad/0xdd273c88cfe239d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207366:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788796767.207372:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796767.207376:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d34fd9ad/0xdd273c88cfe239d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207382:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7600 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.207386:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d34fd9ad/0xdd273c88cfe239d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207404:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d34fd9ad/0xdd273c88cfe239d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207414:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d34fd9ad/0xdd273c88cfe239d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207421:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d34fd9ad/0xdd273c88cfe239d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207434:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.207435:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.207437:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788796767.207823:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788796767.207829:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eedef1e3/0xdd273c88cfe239d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207837:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1788796767.207839:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796767.207843:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eedef1e3/0xdd273c88cfe239d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207852:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eedef1e3/0xdd273c88cfe239d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207861:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eedef1e3/0xdd273c88cfe239d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207879:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eedef1e3/0xdd273c88cfe239d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207892:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788796767.207900:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796767.207904:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eedef1e3/0xdd273c88cfe239d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207911:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6400 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:2.0:1788796767.207914:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eedef1e3/0xdd273c88cfe239d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207921:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eedef1e3/0xdd273c88cfe239d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207931:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eedef1e3/0xdd273c88cfe239d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207938:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eedef1e3/0xdd273c88cfe239d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796767.207951:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.207953:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796767.207954:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788796767.208143:0:15055:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1788796767.208244:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14394:x1875688959348864:12345-0@lo:5:osp-pre-1-0.0 Request processed in 133335us (133496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796767.208260:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788796767.208319:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14394:1875688959348864:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788796767.208335:0:14394:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788796767.208381:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4f8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14394:1875688959348992:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788796767.208416:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796767.208459:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd251a1e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788796767.208476:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959348992 00000100:00100000:2.0:1788796767.208482:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959348992 00000100:00100000:2.0:1788796767.208519:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788796767.208528:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14394:x1875688959348992:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788796767.208565:0:15052:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1788796767.211424:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796767.228638:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14394:x1875688959348992:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20103us (20214us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788796767.228651:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788796767.228957:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4f8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14394:1875688959348992:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788796767.228975:0:14394:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1788796767.961871:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796768.989522:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788796769.766058:0:16127:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788796770.010228:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796771.034055:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796771.678580:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959349120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796771.678661:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796771.678814:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959349120 00000100:00100000:1.0:1788796771.678824:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959349120 00000100:00100000:1.0:1788796771.678893:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788796771.678904:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959349120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796771.678951:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796771.679008:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959349120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796771.679016:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788796771.679304:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959349120:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788796771.679304:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788796772.059376:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796772.202057:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3305:1875688959349248:0@lo:400:kworker.0 00000100:00100000:3.0:1788796772.202209:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796772.202256:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959349760:0@lo:400:kworker.0 00000100:00100000:3.0:1788796772.202284:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796772.202311:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796772.202317:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959349632:0@lo:400:kworker.0 00000100:00100000:3.0:1788796772.202339:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796772.202367:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959349376:0@lo:400:kworker.0 00000100:00100000:3.0:1788796772.202393:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796772.202410:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959349888:0@lo:400:kworker.0 00000100:00100000:3.0:1788796772.202429:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796772.202443:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796772.202448:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959349504:0@lo:400:kworker.0 00000100:00100000:3.0:1788796772.202469:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796772.202502:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959349248 00000100:00100000:3.0:1788796772.202510:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959349248 00000100:00100000:3.0:1788796772.202557:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788796772.202565:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:3305:x1875688959349248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796772.202614:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:3305:x1875688959349248:12345-0@lo:400:kworker.0 Request processed in 49us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796772.202621:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788796772.202649:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959349376 00000100:00100000:3.0:1788796772.202653:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959349376 00000100:00100000:3.0:1788796772.202674:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959349504 00000100:00100000:3.0:1788796772.202677:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959349504 00000100:00100000:3.0:1788796772.202701:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788796772.202720:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959349376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796772.203401:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959349760 00000100:00100000:2.0:1788796772.203408:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959349760 00000100:00100000:2.0:1788796772.203484:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959349632 00000100:00100000:2.0:1788796772.203488:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959349632 00000100:00100000:2.0:1788796772.203505:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959349888 00000100:00100000:2.0:1788796772.203508:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959349888 00000100:00100000:2.0:1788796772.203537:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788796772.203544:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959349760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796772.203600:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959349760:12345-0@lo:400:kworker.0 Request processed in 57us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796772.203607:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788796772.203621:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788796772.203627:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959349632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796772.203655:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959349632:12345-0@lo:400:kworker.0 Request processed in 29us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796772.203661:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788796772.203672:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788796772.203679:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959349888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796772.203705:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959349888:12345-0@lo:400:kworker.0 Request processed in 28us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796772.203711:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788796772.203890:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788796772.203899:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959349504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796772.203945:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959349504:12345-0@lo:400:kworker.0 Request processed in 48us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796772.203950:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788796772.204080:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959349376:12345-0@lo:400:kworker.0 Request processed in 1361us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796772.204087:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788796772.204203:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27e3a9880 x1875688959349632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796772.204218:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959349632:0@lo:400:kworker.0 00000100:00100000:3.0:1788796772.204228:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3305:1875688959349248:0@lo:400:kworker.0 00010000:00080000:3.0:1788796772.204238:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27e3aaa00 x1875688959349760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796772.204246:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959349760:0@lo:400:kworker.0 00000100:00080000:3.0:1788796772.204277:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788796772.204283:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788796772.204299:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959349504:0@lo:400:kworker.0 00000100:00100000:3.0:1788796772.204309:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959349376:0@lo:400:kworker.0 00010000:00080000:3.0:1788796772.204320:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bd27e3a8a80 x1875688959349888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788796788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788796772.204328:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959349888:0@lo:400:kworker.0 00000100:00100000:3.0:1788796772.204338:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796772.204346:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959350016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796772.204376:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796772.204407:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959350016 00000100:00100000:3.0:1788796772.204412:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959350016 00000100:00100000:3.0:1788796772.204450:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788796772.204456:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959350016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788796772.204484:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796772.204519:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959350016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796772.204525:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788796772.204554:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27b4fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959350016:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788796772.298601:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788796772.298628:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788796772.367705:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796772.368081:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936283520 00000100:00100000:2.0:1788796772.368094:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936283520 00000100:00100000:2.0:1788796772.368143:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 76 00000100:00100000:2.0:1788796772.368152:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2354:x1875688936283520:12345-192.168.201.25@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788796772.368183:0:14363:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 1166de96-7c57-41f7-a46b-7894de6a4a61@192.168.201.25@tcp t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:2.0:1788796772.368229:0:14363:0:(genops.c:1384:class_connect()) connect: client 1166de96-7c57-41f7-a46b-7894de6a4a61, cookie 0xdd273c88cfe239df 00000100:00080000:2.0:1788796772.368383:0:14363:0:(import.c:65:import_set_state_nolock()) ffff9bd267245800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788796772.368519:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+5:2354:x1875688936283520:12345-192.168.201.25@tcp:250:mount.lustre.0 Request processed in 366us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796772.368527:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 76 00000100:00100000:1.0:1788796772.383714:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796772.383995:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936283648 00000100:00100000:3.0:1788796772.384006:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936283648 00000100:00100000:3.0:1788796772.384116:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:3.0:1788796772.384127:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+5:13721:x1875688936283648:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788796772.384144:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796772.384163:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd240031800/0xdd273c88cfe239e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ec9d expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796772.384192:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd240031800/0xdd273c88cfe239e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec9d expref: 6 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796772.384204:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd240031800/0xdd273c88cfe239e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ec9d expref: 6 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796772.384213:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240031800, rc 0) 00000100:00100000:3.0:1788796772.384271:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+6:13721:x1875688936283648:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 145us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796772.384278:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:2.0:1788796772.387537:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796772.387668:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936283776 00000100:00100000:3.0:1788796772.387695:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936283776 00000100:00100000:2.0:1788796772.388098:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:2.0:1788796772.388112:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+6:13721:x1875688936283776:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788796772.388494:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+6:13721:x1875688936283776:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 387us (969us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788796772.388504:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:1.0:1788796772.407145:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796772.410981:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936283904 00000100:00100000:3.0:1788796772.411004:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936283904 00000100:00100000:2.0:1788796772.413783:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:2.0:1788796772.413800:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+6:13721:x1875688936283904:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788796772.413830:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796772.413852:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2466b6800/0xdd273c88cfe239ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eca4 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796772.413885:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2466b6800/0xdd273c88cfe239ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eca4 expref: 7 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796772.413897:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2466b6800/0xdd273c88cfe239ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eca4 expref: 7 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796772.413907:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6800, rc 0) 00000100:00100000:2.0:1788796772.413996:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+7:13721:x1875688936283904:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 199us (6861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796772.414022:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:0.0:1788796772.417467:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796772.418485:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936284032 00000100:00100000:2.0:1788796772.418501:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936284032 00000100:00100000:2.0:1788796772.418573:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:2.0:1788796772.418585:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+7:13721:x1875688936284032:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788796772.418946:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+8:13721:x1875688936284032:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 363us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796772.418954:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:3.0:1788796772.429291:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796772.429415:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936284160 00000100:00100000:0.0:1788796772.429433:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936284160 00000100:00100000:0.0:1788796772.429507:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:0.0:1788796772.429520:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+8:13721:x1875688936284160:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788796772.429907:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+8:13721:x1875688936284160:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 389us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796772.429925:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:0.0:1788796772.436790:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796772.436883:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936284288 00000100:00100000:1.0:1788796772.436894:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936284288 00000100:00100000:1.0:1788796772.436956:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:1.0:1788796772.436967:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+8:13739:x1875688936284288:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788796772.437290:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+8:13739:x1875688936284288:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 324us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796772.437306:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:3.0:1788796772.493452:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796772.497686:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936284416 00000100:00100000:2.0:1788796772.497704:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936284416 00000100:00100000:3.0:1788796772.506306:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00100000:3.0:1788796772.506323:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+8:13739:x1875688936284416:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788796772.506609:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+8:13739:x1875688936284416:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 289us (13168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796772.506617:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00100000:3.0:1788796772.510506:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796772.511189:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936284544 00000100:00100000:0.0:1788796772.511204:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936284544 00000100:00100000:0.0:1788796772.511268:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:0.0:1788796772.511279:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+8:13721:x1875688936284544:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788796772.511296:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796772.511315:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd141d5a000/0xdd273c88cfe239f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ecce expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796772.511345:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd141d5a000/0xdd273c88cfe239f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ecce expref: 9 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796772.511356:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd141d5a000/0xdd273c88cfe239f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ecce expref: 9 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796772.511385:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5a000, rc 0) 00000100:00100000:0.0:1788796772.511449:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+9:13721:x1875688936284544:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 171us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796772.511456:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:0.0:1788796772.518312:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796772.518546:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936284672 00000100:00100000:1.0:1788796772.518556:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936284672 00000100:00100000:1.0:1788796772.518600:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:1.0:1788796772.518608:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+9:13721:x1875688936284672:12345-192.168.201.25@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788796772.518631:0:14364:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788796772.518655:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788796772.518658:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788796772.518660:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788796772.518662:0:14364:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788796772.522800:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+9:13721:x1875688936284672:12345-192.168.201.25@tcp:256:mount.lustre.0 Request processed in 4181us (4486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796772.522817:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:3.0:1788796772.530832:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796772.531285:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936284800 00000100:00100000:0.0:1788796772.531298:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936284800 00000100:00100000:0.0:1788796772.531359:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:0.0:1788796772.532250:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27fa58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+9:13721:x1875688936284800:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788796772.532281:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796772.532303:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd141d5bc00/0xdd273c88cfe239fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ecd5 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796772.532334:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd141d5bc00/0xdd273c88cfe239fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ecd5 expref: 10 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796772.532347:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd141d5bc00/0xdd273c88cfe239fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ecd5 expref: 10 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796772.532356:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5bc00, rc 0) 00000100:00100000:0.0:1788796772.533343:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27fa58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+10:13721:x1875688936284800:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 1968us (2515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796772.533355:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:0.0:1788796772.544247:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796772.544967:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936284928 00000100:00100000:1.0:1788796772.544978:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936284928 00000100:00100000:1.0:1788796772.545099:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:1.0:1788796772.545110:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+10:13721:x1875688936284928:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788796772.545420:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+10:13721:x1875688936284928:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 312us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796772.545428:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:3.0:1788796772.553255:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796772.553365:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936285056 00000100:00100000:0.0:1788796772.553375:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936285056 00000100:00100000:0.0:1788796772.553450:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 88 00000100:00100000:0.0:1788796772.553461:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+10:13721:x1875688936285056:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788796772.553718:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+10:13721:x1875688936285056:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 259us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796772.553733:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 88 00000100:00100000:2.0:1788796772.564313:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796772.564631:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936285184 00000100:00100000:1.0:1788796772.564643:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936285184 00000100:00100000:1.0:1788796772.564702:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 89 00000100:00100000:1.0:1788796772.564712:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+10:13743:x1875688936285184:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788796772.565033:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+10:13743:x1875688936285184:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 321us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796772.565049:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 89 00000040:00080000:3.0:1788796772.570522:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788796772.590128:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796772.595181:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936285312 00000100:00100000:0.0:1788796772.595203:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936285312 00000100:00100000:2.0:1788796772.595399:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:2.0:1788796772.595412:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+10:13743:x1875688936285312:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788796772.595698:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+10:13743:x1875688936285312:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 287us (5580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796772.595706:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:0.0:1788796772.623675:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796772.623797:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936285440 00000100:00100000:2.0:1788796772.623817:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936285440 00000100:00100000:2.0:1788796772.623878:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:2.0:1788796772.623888:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2354:x1875688936285440:12345-192.168.201.25@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788796772.624002:0:14369:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from fdf0c7da-3089-41ff-814e-0e93baa9b34e@192.168.201.25@tcp t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:2.0:1788796772.624080:0:14369:0:(genops.c:1384:class_connect()) connect: client fdf0c7da-3089-41ff-814e-0e93baa9b34e, cookie 0xdd273c88cfe23a02 00000004:00100000:2.0:1788796772.624118:0:14369:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788796772.624124:0:14369:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788796772.742166:0:14369:0:(import.c:65:import_set_state_nolock()) ffff9bd250afa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788796772.742328:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:2354:x1875688936285440:12345-192.168.201.25@tcp:38:mount.lustre.0 Request processed in 118438us (118665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796772.742340:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:3.0:1788796772.768146:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796772.768519:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936285696 00000100:00100000:2.0:1788796772.768532:0:15986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936285696 00000100:00100000:2.0:1788796772.768626:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1788796772.768637:0:15986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:13721:x1875688936285696:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788796772.768684:0:15986:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1788796772.768778:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796772.772301:0:15986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:13721:x1875688936285696:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 3650us (4150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796772.772319:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:1.0:1788796772.776432:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796772.776702:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936285568 00000100:00100000:0.0:1788796772.776714:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936285568 00000100:00100000:0.0:1788796772.776838:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:0.0:1788796772.776849:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:0:x1875688936285568:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788796772.776886:0:14371:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788796772.777015:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:0:x1875688936285568:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 167us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796772.777022:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:2.0:1788796772.778126:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796772.778382:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936285824 00000100:00100000:1.0:1788796772.778392:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936285824 00000100:00100000:1.0:1788796772.778445:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:1.0:1788796772.778454:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:13721:x1875688936285824:12345-192.168.201.25@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788796772.778552:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:13721:x1875688936285824:12345-192.168.201.25@tcp:40:mount.lustre.0 Request processed in 98us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796772.778559:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1788796772.781987:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796772.782357:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936285952 00000100:00100000:0.0:1788796772.782370:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936285952 00000100:00100000:0.0:1788796772.782422:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1788796772.782432:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1875688936285952:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788796772.782464:0:15052:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fdf0c7da-3089-41ff-814e-0e93baa9b34e@192.168.201.25@tcp t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:0.0:1788796772.782508:0:15052:0:(genops.c:1384:class_connect()) connect: client fdf0c7da-3089-41ff-814e-0e93baa9b34e, cookie 0xdd273c88cfe23a09 00002000:00100000:0.0:1788796772.782521:0:15052:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fdf0c7da-3089-41ff-814e-0e93baa9b34e/ffff9bd2794d3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788796772.782533:0:15052:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788796772.782939:0:15052:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788796772.782988:0:15052:0:(import.c:65:import_set_state_nolock()) ffff9bd2794d2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788796772.783071:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:2354:x1875688936285952:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 638us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796772.783078:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1788796772.804362:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796772.804449:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936286080 00000100:00100000:3.0:1788796772.804460:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936286080 00000100:00100000:3.0:1788796772.804523:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1788796772.804533:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1875688936286080:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788796772.804591:0:15055:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from fdf0c7da-3089-41ff-814e-0e93baa9b34e@192.168.201.25@tcp t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:3.0:1788796772.804628:0:15055:0:(genops.c:1384:class_connect()) connect: client fdf0c7da-3089-41ff-814e-0e93baa9b34e, cookie 0xdd273c88cfe23a10 00002000:00100000:3.0:1788796772.804641:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fdf0c7da-3089-41ff-814e-0e93baa9b34e/ffff9bd250afa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788796772.804653:0:15055:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788796772.805070:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788796772.805105:0:15055:0:(import.c:65:import_set_state_nolock()) ffff9bd250afd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788796772.805181:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:2354:x1875688936286080:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 647us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796772.805188:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:2.0:1788796772.813061:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796772.814435:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936286208 00000100:00100000:3.0:1788796772.814449:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936286208 00000100:00100000:3.0:1788796772.814524:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:3.0:1788796772.814535:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:13721:x1875688936286208:12345-192.168.201.25@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788796772.818257:0:14372:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3647us 00000004:00200000:3.0:1788796772.845963:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788796772.846326:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:13721:x1875688936286208:12345-192.168.201.25@tcp:33:mount.lustre.0 Request processed in 31787us (33280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796772.846337:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:1.0:1788796773.063805:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796773.064068:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936286336 00000100:00100000:3.0:1788796773.064080:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936286336 00000100:00100000:3.0:1788796773.064156:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:3.0:1788796773.064168:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:13764:x1875688936286336:12345-192.168.201.25@tcp:101:mkdir.0 00010000:00010000:3.0:1788796773.064190:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796773.064216:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030200/0xdd273c88cfe23a17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ecff expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796773.064304:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23a1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796773.064320:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796773.064336:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788796773.064372:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788796773.064376:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788796773.064411:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796773.064437:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030200/0xdd273c88cfe23a17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ecff expref: 8 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796773.064455:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23a1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ecff expref: 7 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796773.064464:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:3.0:1788796773.064467:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788796773.064470:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240031600, rc 0) 00000100:00100000:3.0:1788796773.064725:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+7:13764:x1875688936286336:12345-192.168.201.25@tcp:101:mkdir.0 Request processed in 558us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796773.064733:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00010000:00010000:1.0:1788796773.082000:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796774.105959:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796775.130016:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796775.458921:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796775.460924:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936286464 00000100:00100000:1.0:1788796775.460952:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936286464 00000100:00100000:1.0:1788796775.461062:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:1.0:1788796775.461076:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+7:13816:x1875688936286464:12345-192.168.201.25@tcp:41:lfs.0 00000004:00000024:1.0:1788796775.461133:0:14370:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788796775.461251:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+7:13816:x1875688936286464:12345-192.168.201.25@tcp:41:lfs.0 Request processed in 179us (2343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796775.461258:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00080000:3.0:1788796775.462042:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796775.470148:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796775.470814:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936286592 00000100:00100000:3.0:1788796775.470840:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936286592 00000100:00100000:3.0:1788796775.470926:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:3.0:1788796775.470939:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:13816:x1875688936286592:12345-192.168.201.25@tcp:13:lfs.0 00002000:00000024:3.0:1788796775.470986:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796775.471090:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:13816:x1875688936286592:12345-192.168.201.25@tcp:13:lfs.0 Request processed in 153us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796775.471097:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00080000:2.0:1788796775.472429:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796775.481589:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796775.482047:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936286720 00000100:00100000:3.0:1788796775.482067:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936286720 00000100:00100000:3.0:1788796775.482138:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:3.0:1788796775.482150:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:13816:x1875688936286720:12345-192.168.201.25@tcp:13:lfs.0 00002000:00000024:3.0:1788796775.482191:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796775.482285:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:13816:x1875688936286720:12345-192.168.201.25@tcp:13:lfs.0 Request processed in 137us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796775.482301:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00080000:2.0:1788796775.483811:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788796775.806180:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796775.806319:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936286848 00000100:00100000:3.0:1788796775.806329:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936286848 00000100:00100000:3.0:1788796775.806391:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 91 00000100:00100000:3.0:1788796775.806402:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+10:13848:x1875688936286848:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788796775.806420:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796775.806440:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd240030200/0xdd273c88cfe23a25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ed06 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796775.806471:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd240030200/0xdd273c88cfe23a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed06 expref: 11 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796775.806483:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd240030200/0xdd273c88cfe23a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed06 expref: 11 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796775.807150:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240030200, rc 0) 00000100:00100000:3.0:1788796775.807279:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+11:13848:x1875688936286848:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 876us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796775.807287:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 91 00000100:00100000:0.0:1788796775.822011:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796775.822141:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936286976 00000100:00100000:2.0:1788796775.822152:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936286976 00000100:00100000:2.0:1788796775.822211:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 92 00000100:00100000:2.0:1788796775.822222:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+11:13848:x1875688936286976:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788796775.822653:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+11:13848:x1875688936286976:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 432us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796775.822662:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 92 00000100:00100000:0.0:1788796775.845468:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796775.845544:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936287104 00000100:00100000:3.0:1788796775.845554:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936287104 00000100:00100000:3.0:1788796775.845656:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 93 00000100:00100000:3.0:1788796775.845667:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+11:13848:x1875688936287104:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788796775.846043:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+11:13848:x1875688936287104:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 377us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796775.846051:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 93 00000100:00100000:0.0:1788796775.861899:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796775.861973:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936287232 00000100:00100000:1.0:1788796775.861985:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936287232 00000100:00100000:1.0:1788796775.862054:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:1.0:1788796775.862066:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+11:13855:x1875688936287232:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788796775.862447:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+11:13855:x1875688936287232:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 382us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796775.862455:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:0.0:1788796775.890731:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796775.890904:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936287360 00000100:00100000:3.0:1788796775.890915:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936287360 00000100:00100000:3.0:1788796775.890973:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 95 00000100:00100000:3.0:1788796775.890983:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+11:13855:x1875688936287360:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788796775.891295:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+11:13855:x1875688936287360:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 312us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796775.891303:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 95 00000100:00100000:0.0:1788796775.906911:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796775.907085:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936287488 00000100:00100000:2.0:1788796775.907097:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936287488 00000100:00100000:2.0:1788796775.907163:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:2.0:1788796775.907174:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+11:13848:x1875688936287488:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788796775.907195:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796775.907216:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2466b6600/0xdd273c88cfe23a2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ed30 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796775.907265:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2466b6600/0xdd273c88cfe23a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed30 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796775.907276:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2466b6600/0xdd273c88cfe23a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed30 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796775.907285:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6600, rc 0) 00000100:00100000:2.0:1788796775.907343:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+12:13848:x1875688936287488:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 170us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796775.907350:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:0.0:1788796775.915713:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796775.915953:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936287616 00000100:00100000:1.0:1788796775.915965:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936287616 00000100:00100000:1.0:1788796775.916035:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00100000:1.0:1788796775.916047:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+12:13848:x1875688936287616:12345-192.168.201.25@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788796775.916077:0:14364:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788796775.916115:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788796775.916121:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788796775.916124:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788796775.916127:0:14364:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788796775.918307:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+12:13848:x1875688936287616:12345-192.168.201.25@tcp:256:mount.lustre.0 Request processed in 2250us (2603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796775.918323:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00100000:0.0:1788796775.926343:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796775.926608:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936287744 00000100:00100000:3.0:1788796775.926621:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936287744 00000100:00100000:3.0:1788796775.927044:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 98 00000100:00100000:3.0:1788796775.927057:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+12:13848:x1875688936287744:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788796775.927078:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796775.927106:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe23a33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ed37 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796775.927151:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe23a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed37 expref: 13 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796775.927162:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe23a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed37 expref: 13 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796775.927171:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240030e00, rc 0) 00000100:00100000:3.0:1788796775.927229:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+13:13848:x1875688936287744:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 175us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796775.927236:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 98 00000100:00100000:0.0:1788796775.938788:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796775.938962:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936287872 00000100:00100000:1.0:1788796775.938973:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936287872 00000100:00100000:1.0:1788796775.939180:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:1.0:1788796775.939192:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+13:13848:x1875688936287872:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788796775.939500:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+13:13848:x1875688936287872:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 310us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796775.939508:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:0.0:1788796775.941879:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796775.941959:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936288000 00000100:00100000:3.0:1788796775.941968:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936288000 00000100:00100000:3.0:1788796775.942030:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:3.0:1788796775.942041:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+13:13848:x1875688936288000:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788796775.942363:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+13:13848:x1875688936288000:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 323us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796775.942371:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:0.0:1788796775.946214:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796775.946362:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936288128 00000100:00100000:3.0:1788796775.947323:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936288128 00000100:00100000:3.0:1788796775.947412:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:3.0:1788796775.947423:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+13:13860:x1875688936288128:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788796775.947727:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+13:13860:x1875688936288128:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 305us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796775.947735:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:0.0:1788796775.960923:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796775.961063:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936288256 00000100:00100000:1.0:1788796775.961076:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936288256 00000100:00100000:1.0:1788796775.961153:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 102 00000100:00100000:1.0:1788796775.961165:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ce38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+13:13860:x1875688936288256:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788796775.961458:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ce38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+13:13860:x1875688936288256:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 295us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796775.961465:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 102 00000100:00100000:0.0:1788796775.973376:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796775.973475:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796775.973516:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796775.973573:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936288896 00000100:00100000:1.0:1788796775.973584:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936288896 00000100:00100000:1.0:1788796775.973650:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:1.0:1788796775.973660:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:2356:x1875688936288896:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796775.973737:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:2356:x1875688936288896:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 79us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796775.973773:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:0.0:1788796775.976782:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796775.977037:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936289024 00000100:00100000:1.0:1788796775.977047:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936289024 00000100:00100000:1.0:1788796775.977109:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:1.0:1788796775.977119:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:2356:x1875688936289024:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796775.977190:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:2356:x1875688936289024:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 72us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796775.977197:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:2.0:1788796775.980550:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936288384 00000100:00100000:2.0:1788796775.980566:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936288384 00000100:00100000:2.0:1788796775.980620:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936288768 00000100:00100000:2.0:1788796775.980623:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936288768 00000100:00100000:2.0:1788796775.980665:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:2.0:1788796775.980674:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+7:2356:x1875688936288768:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796775.980780:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+7:2356:x1875688936288768:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 107us (7263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796775.980787:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:2.0:1788796775.980805:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:2.0:1788796775.980809:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2354:x1875688936288384:12345-192.168.201.25@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788796775.980831:0:14371:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ebcda21d-22f8-459b-b210-3710c508852e@192.168.201.25@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:2.0:1788796775.980886:0:14371:0:(genops.c:1384:class_connect()) connect: client ebcda21d-22f8-459b-b210-3710c508852e, cookie 0xdd273c88cfe23a3a 00000004:00100000:2.0:1788796775.980916:0:14371:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788796775.981043:0:14371:0:(import.c:65:import_set_state_nolock()) ffff9bd267240800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788796775.981089:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebcda21d-22f8-459b-b210-3710c508852e+6:2354:x1875688936288384:12345-192.168.201.25@tcp:38:mount.lustre.0 Request processed in 277us (7725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796775.981095:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:0.0:1788796775.999071:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796775.999283:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936288512 00000100:00100000:2.0:1788796775.999306:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936288512 00000100:00100000:2.0:1788796775.999395:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00080000:3.0:1788796775.999399:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796775.999406:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebcda21d-22f8-459b-b210-3710c508852e+6:0:x1875688936288512:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788796775.999444:0:14371:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788796775.999535:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebcda21d-22f8-459b-b210-3710c508852e+6:0:x1875688936288512:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 130us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796775.999542:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:2.0:1788796775.999650:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796775.999731:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936288640 00000100:00100000:3.0:1788796775.999736:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936288640 00000100:00100000:3.0:1788796775.999796:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:3.0:1788796775.999804:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26799ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebcda21d-22f8-459b-b210-3710c508852e+6:13848:x1875688936288640:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788796775.999817:0:14370:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788796775.999847:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26799ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebcda21d-22f8-459b-b210-3710c508852e+6:13848:x1875688936288640:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 43us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796775.999865:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:2.0:1788796776.005499:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796776.005616:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936289152 00000100:00100000:0.0:1788796776.005626:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936289152 00000100:00100000:0.0:1788796776.005673:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:0.0:1788796776.005683:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebcda21d-22f8-459b-b210-3710c508852e+6:13848:x1875688936289152:12345-192.168.201.25@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788796776.005860:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ebcda21d-22f8-459b-b210-3710c508852e+6:13848:x1875688936289152:12345-192.168.201.25@tcp:40:mount.lustre.0 Request processed in 169us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796776.005868:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:1.0:1788796776.017071:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796776.017114:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796776.017150:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796776.017693:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936289536 00000100:00100000:2.0:1788796776.017706:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936289536 00000100:00100000:2.0:1788796776.017795:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:2.0:1788796776.017807:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ebcda21d-22f8-459b-b210-3710c508852e+6:13848:x1875688936289536:12345-192.168.201.25@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788796776.017893:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788796776.017969:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ebcda21d-22f8-459b-b210-3710c508852e+6:13848:x1875688936289536:12345-192.168.201.25@tcp:33:mount.lustre.0 Request processed in 165us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796776.017978:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:0.0:1788796776.018299:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936289408 00000100:00100000:0.0:1788796776.018305:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936289408 00000100:00100000:0.0:1788796776.018334:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:0.0:1788796776.018340:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1875688936289408:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788796776.018373:0:15052:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ebcda21d-22f8-459b-b210-3710c508852e@192.168.201.25@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:0.0:1788796776.018408:0:15052:0:(genops.c:1384:class_connect()) connect: client ebcda21d-22f8-459b-b210-3710c508852e, cookie 0xdd273c88cfe23a41 00002000:00100000:0.0:1788796776.018420:0:15052:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ebcda21d-22f8-459b-b210-3710c508852e/ffff9bd2794d0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788796776.018432:0:15052:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788796776.018556:0:15052:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788796776.018587:0:15052:0:(import.c:65:import_set_state_nolock()) ffff9bd2794d3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788796776.018618:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebcda21d-22f8-459b-b210-3710c508852e+6:2354:x1875688936289408:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 277us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796776.018624:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:3.0:1788796776.018789:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936289280 00000100:00100000:3.0:1788796776.018795:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936289280 00000100:00100000:3.0:1788796776.018825:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:3.0:1788796776.018831:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875688936289280:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788796776.018845:0:15054:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ebcda21d-22f8-459b-b210-3710c508852e@192.168.201.25@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:3.0:1788796776.018876:0:15054:0:(genops.c:1384:class_connect()) connect: client ebcda21d-22f8-459b-b210-3710c508852e, cookie 0xdd273c88cfe23a48 00002000:00100000:3.0:1788796776.018881:0:15054:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ebcda21d-22f8-459b-b210-3710c508852e/ffff9bd27ead7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788796776.018887:0:15054:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788796776.018945:0:15054:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788796776.018961:0:15054:0:(import.c:65:import_set_state_nolock()) ffff9bd24533d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788796776.018986:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebcda21d-22f8-459b-b210-3710c508852e+6:2354:x1875688936289280:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 153us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796776.018993:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00010000:00010000:2.0:1788796776.154279:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796776.276416:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796776.276497:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936289664 00000100:00100000:0.0:1788796776.276511:0:15986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936289664 00000100:00100000:0.0:1788796776.276575:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:0.0:1788796776.276585:0:15986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebcda21d-22f8-459b-b210-3710c508852e+6:13881:x1875688936289664:12345-192.168.201.25@tcp:101:mkdir.0 00010000:00010000:0.0:1788796776.276607:0:15986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796776.276631:0:15986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a600/0xdd273c88cfe23a4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ed61 expref: -99 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796776.276706:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a800/0xdd273c88cfe23a56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796776.276734:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a800/0xdd273c88cfe23a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796776.276781:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a800/0xdd273c88cfe23a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796776.276823:0:15986:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788796776.276827:0:15986:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788796776.276858:0:15986:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a800/0xdd273c88cfe23a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796776.276887:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a600/0xdd273c88cfe23a4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed61 expref: 8 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796776.276917:0:15986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a800/0xdd273c88cfe23a56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed61 expref: 7 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796776.276928:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:0.0:1788796776.276931:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788796776.276936:0:15986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5a800, rc 0) 00000100:00100000:0.0:1788796776.277000:0:15986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebcda21d-22f8-459b-b210-3710c508852e+7:13881:x1875688936289664:12345-192.168.201.25@tcp:101:mkdir.0 Request processed in 416us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796776.277008:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:0.0:1788796776.794319:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959350144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796776.794391:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796776.794524:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959350144 00000100:00100000:1.0:1788796776.794532:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959350144 00000100:00100000:1.0:1788796776.794609:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788796776.794618:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e378e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959350144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796776.794639:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796776.794700:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e378e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959350144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796776.794708:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788796776.794784:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959350144:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788796776.795104:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788796776.843378:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdf0c7da-3089-41ff-814e-0e93baa9b34e 00000001:00100000:3.0:1788796776.843516:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ebcda21d-22f8-459b-b210-3710c508852e 00010000:00010000:3.0:1788796777.183270:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796777.308473:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788796777.308499:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959350272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796777.308589:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796777.308683:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959350272 00000100:00100000:3.0:1788796777.308692:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959350272 00000100:00100000:3.0:1788796777.308777:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788796777.308787:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959350272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788796777.308821:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788796777.308881:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959350272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796777.308888:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788796777.308916:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3306:1875688959350400:0@lo:400:kworker.0 00000100:00100000:0.0:1788796777.308948:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959350528:0@lo:400:kworker.0 00000100:00100000:3.0:1788796777.308961:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796777.308978:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796777.308986:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959350912:0@lo:400:kworker.0 00000100:00100000:3.0:1788796777.309009:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796777.309015:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959350528 00000100:00100000:0.0:1788796777.309018:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959350528 00000100:00100000:0.0:1788796777.309044:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788796777.309051:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959350528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796777.309088:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959350528:12345-0@lo:400:kworker.0 Request processed in 37us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796777.309094:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788796777.309122:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e37bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959350784:0@lo:400:kworker.0 00000100:00100000:0.0:1788796777.309130:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959350528:0@lo:400:kworker.0 00000100:00100000:1.0:1788796777.309151:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796777.309175:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959350912 00000100:00100000:1.0:1788796777.309176:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788796777.309179:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959350912 00000100:00100000:1.0:1788796777.309181:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959350656:0@lo:400:kworker.0 00000100:00100000:1.0:1788796777.309202:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788796777.309275:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788796777.309280:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788796777.311873:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959350784 00000100:00100000:0.0:1788796777.311889:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959350784 00000100:00100000:0.0:1788796777.311953:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959350656 00000100:00100000:0.0:1788796777.311958:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959350656 00000100:00100000:0.0:1788796777.311976:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788796777.311986:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959350912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796777.312188:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788796777.312198:0:15986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959350784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796777.312270:0:14369:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788796777.312287:0:14369:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788796777.312374:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959350400 00000100:00100000:3.0:1788796777.312380:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959350400 00000100:00100000:3.0:1788796777.312412:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788796777.312419:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:3306:x1875688959350400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796777.313166:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788796777.313179:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959350656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788796777.319400:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959350912:12345-0@lo:400:kworker.0 Request processed in 7402us (10376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796777.319417:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788796777.319795:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959350656:12345-0@lo:400:kworker.0 Request processed in 6618us (10589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796777.319804:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788796777.319884:0:15986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959350784:12345-0@lo:400:kworker.0 Request processed in 7686us (10728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796777.319893:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788796777.320291:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959350656:0@lo:400:kworker.0 00000100:00100000:1.0:1788796777.320310:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e37bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959350784:0@lo:400:kworker.0 00000100:00080000:0.0:1788796777.320394:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788796777.320426:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959350912:0@lo:400:kworker.0 00000100:00100000:0.0:1788796777.320495:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:3306:x1875688959350400:12345-0@lo:400:kworker.0 Request processed in 8076us (11531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796777.320850:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788796777.320875:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959350272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788796777.322383:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788796777.322482:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3306:1875688959350400:0@lo:400:kworker.0 00000001:00100000:0.0:1788796777.423532:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ebcda21d-22f8-459b-b210-3710c508852e 00000001:00100000:0.0:1788796777.423548:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdf0c7da-3089-41ff-814e-0e93baa9b34e 00000001:00100000:2.0:1788796777.902365:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ebcda21d-22f8-459b-b210-3710c508852e 00000001:00100000:2.0:1788796777.902381:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fdf0c7da-3089-41ff-814e-0e93baa9b34e 00010000:00010000:2.0:1788796778.201992:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796779.225972:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788796779.976471:0:16333:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788796780.249967:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788796781.274247:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796781.452968:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796781.453049:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936289792 00000100:00100000:0.0:1788796781.453059:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936289792 00000100:00100000:0.0:1788796781.453117:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00100000:0.0:1788796781.453128:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+13:2357:x1875688936289792:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788796781.453212:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+13:2357:x1875688936289792:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 85us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796781.453220:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00100000:0.0:1788796781.462741:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796781.463397:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936289920 00000100:00100000:3.0:1788796781.463409:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936289920 00000100:00100000:3.0:1788796781.463485:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:3.0:1788796781.463498:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:2357:x1875688936289920:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796781.463583:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:2357:x1875688936289920:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 88us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796781.463605:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00080000:2.0:1788796781.463788:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796781.466811:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796781.466847:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796781.466866:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796781.466892:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796781.466914:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796781.466941:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936290176 00000100:00100000:2.0:1788796781.466951:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936290176 00000100:00100000:2.0:1788796781.467003:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936290432 00000100:00100000:2.0:1788796781.467007:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936290432 00000100:00100000:2.0:1788796781.467020:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936290048 00000100:00100000:2.0:1788796781.467021:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936290048 00000100:00100000:2.0:1788796781.467033:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936290560 00000100:00100000:2.0:1788796781.467035:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936290560 00000100:00100000:2.0:1788796781.467049:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:2.0:1788796781.467058:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+5:2358:x1875688936290176:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796781.467128:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+5:2358:x1875688936290176:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 71us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796781.467145:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:2.0:1788796781.467163:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1788796781.467169:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebcda21d-22f8-459b-b210-3710c508852e+5:2358:x1875688936290432:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796781.467196:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebcda21d-22f8-459b-b210-3710c508852e+5:2358:x1875688936290432:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 28us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796781.467201:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1788796781.467211:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:2.0:1788796781.467217:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+5:2358:x1875688936290048:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796781.467237:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+5:2358:x1875688936290048:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 20us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796781.467243:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:2.0:1788796781.467252:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:2.0:1788796781.467258:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebcda21d-22f8-459b-b210-3710c508852e+5:2358:x1875688936290560:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796781.467277:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ebcda21d-22f8-459b-b210-3710c508852e+5:2358:x1875688936290560:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 20us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796781.467282:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:2.0:1788796781.467301:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936290304 00000100:00100000:2.0:1788796781.467304:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936290304 00000100:00100000:2.0:1788796781.467332:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:2.0:1788796781.467338:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebcda21d-22f8-459b-b210-3710c508852e+6:2358:x1875688936290304:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788796781.467362:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebcda21d-22f8-459b-b210-3710c508852e+6:2358:x1875688936290304:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 24us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796781.467367:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00080000:2.0:1788796781.467803:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788796781.467809:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788796781.467811:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788796781.917276:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959351040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796781.917360:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796781.929838:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959351040 00000100:00100000:0.0:1788796781.929857:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959351040 00000100:00100000:0.0:1788796781.929936:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788796781.929947:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959351040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788796781.929992:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796781.930106:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959351040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (12745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796781.930114:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788796781.930310:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959351040:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788796781.940367:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788796782.299361:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796782.425921:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796782.425945:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959351168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796782.426017:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796782.430319:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959351168 00000100:00100000:0.0:1788796782.430337:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959351168 00000100:00100000:0.0:1788796782.430406:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788796782.430669:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959351168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788796782.430705:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788796782.430825:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959351168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (4807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796782.430846:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788796782.430882:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788796782.430916:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959351168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796782.442935:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959351680:0@lo:400:kworker.0 00000100:00100000:2.0:1788796782.442942:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3305:1875688959351296:0@lo:400:kworker.0 00000100:00100000:2.0:1788796782.446307:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796782.446384:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875688959351808:0@lo:400:kworker.0 00000100:00100000:2.0:1788796782.446431:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796782.448133:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959351296 00000100:00100000:1.0:1788796782.448148:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959351296 00000100:00100000:1.0:1788796782.448224:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788796782.448243:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:3305:x1875688959351296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788796782.448328:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:3305:x1875688959351296:12345-0@lo:400:kworker.0 Request processed in 96us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796782.448335:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788796782.448567:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3305:1875688959351296:0@lo:400:kworker.0 00000100:00100000:3.0:1788796782.448621:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959351808 00000100:00100000:3.0:1788796782.448627:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959351808 00000100:00100000:3.0:1788796782.448678:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788796782.448687:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875688959351808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796782.448728:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875688959351808:12345-0@lo:400:kworker.0 Request processed in 44us (2297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796782.448735:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788796782.448787:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959351424:0@lo:400:kworker.0 00000100:00100000:3.0:1788796782.448822:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796782.448845:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788796782.448853:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959351552:0@lo:400:kworker.0 00000100:00100000:3.0:1788796782.448875:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796782.448901:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959351552 00000100:00100000:3.0:1788796782.448905:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959351552 00000100:00100000:3.0:1788796782.448926:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788796782.448932:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959351552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796782.448966:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875688959351552:12345-0@lo:400:kworker.0 Request processed in 34us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796782.448972:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788796782.449021:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875688959351552:0@lo:400:kworker.0 00000100:00100000:3.0:1788796782.449077:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788796782.450550:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796782.450572:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959351424 00000100:00100000:2.0:1788796782.450580:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959351424 00000100:00100000:2.0:1788796782.450637:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788796782.450648:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959351424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796782.450730:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875688959351424:12345-0@lo:400:kworker.0 Request processed in 86us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796782.450768:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788796782.450794:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959351680 00000100:00100000:2.0:1788796782.450798:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959351680 00000100:00100000:2.0:1788796782.450834:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788796782.450841:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959351680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796782.450878:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959351680:12345-0@lo:400:kworker.0 Request processed in 38us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796782.450885:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788796782.450931:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959351680:0@lo:400:kworker.0 00000100:00080000:2.0:1788796782.450965:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796782.450985:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875688959351808:0@lo:400:kworker.0 00000100:00100000:1.0:1788796782.451200:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959351424:0@lo:400:kworker.0 00000040:00080000:0.0:1788796782.810550:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788796783.325018:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788796783.856501:0:16482:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca6595ed0 20000000:00000080:3.0:1788796783.856516:0:16482:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bd142bf2400 uarg=0000000000000000 20000000:01000000:3.0:1788796783.856543:0:16482:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788796783.856548:0:16482:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788796783.856551:0:16482:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788796783.857367:0:16483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788796783.857516:0:16482:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788796783.861498:0:16482:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788796783.861592:0:16482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bd14316a000/0xdd273c88cfe23a5d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796783.861616:0:16482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe23754 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2374d expref: 18 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796783.861628:0:16482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe237a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe2379a expref: 18 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796783.861634:0:16482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd141d5ac00/0xdd273c88cfe238d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe238ce expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796783.861644:0:16482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd141d5bc00/0xdd273c88cfe239fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ecd5 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796783.861651:0:16482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe23a33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed37 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796783.861657:0:16482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bd14316a000/0xdd273c88cfe23a5d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796783.861709:0:16482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe23a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed37 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796783.861744:0:16482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe23a33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed37 expref: 12 pid: 14362 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796783.861775:0:16482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16482:1875688959351936:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796783.861905:0:16482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd141d5bc00/0xdd273c88cfe239fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ecd5 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796783.861924:0:16482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd141d5bc00/0xdd273c88cfe239fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ecd5 expref: 12 pid: 14363 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796783.861933:0:16482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16482:1875688959352064:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796783.861968:0:16482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd141d5ac00/0xdd273c88cfe238d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe238ce expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796783.861976:0:16482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd141d5ac00/0xdd273c88cfe238d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe238ce expref: 18 pid: 14363 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796783.861985:0:16482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16482:1875688959352192:0@lo:104: 00000100:00100000:1.0:1788796783.862024:0:16482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796783.862061:0:16482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe237a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe2379a expref: 18 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796783.862068:0:16482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe237a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe2379a expref: 18 pid: 14364 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796783.862075:0:16482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16482:1875688959352320:0@lo:104: 00000100:00100000:1.0:1788796783.862094:0:16482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788796783.862116:0:16482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe23754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdd273c88cfe2374d expref: 18 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796783.862123:0:16482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe23754 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdd273c88cfe2374d expref: 18 pid: 14364 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796783.862131:0:16482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16482:1875688959352448:0@lo:104: 00000100:00100000:0.0:1788796783.862154:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959352192 00000100:00100000:1.0:1788796783.862161:0:16482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796783.862162:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959352192 00000100:00100000:1.0:1788796783.862173:0:16482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26c676e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788796783.862211:0:14353:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788796783.862222:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959352320 00000100:00100000:0.0:1788796783.862224:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959352320 00000100:00100000:0.0:1788796783.862236:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959352448 00000100:00100000:0.0:1788796783.862238:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959352448 00000100:00100000:0.0:1788796783.862250:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788796783.862258:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+5:16482:x1875688959352192:12345-0@lo:104: 00010000:00010000:0.0:1788796783.862272:0:14353:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd267335200/0xdd273c88cfe238ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe238d5 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.862332:0:14353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788796783.862338:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+5:16482:x1875688959352192:12345-0@lo:104: Request processed in 81us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796783.862414:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788796783.862434:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788796783.862440:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+4:16482:x1875688959352320:12345-0@lo:104: 00010000:00010000:0.0:1788796783.862448:0:14353:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe2379a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe237a1 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.862491:0:14353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788796783.862496:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+4:16482:x1875688959352320:12345-0@lo:104: Request processed in 56us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796783.862509:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788796783.862510:0:16482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16482:1875688959352192:0@lo:104: 00000100:00100000:1.0:1788796783.862519:0:16482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16482:1875688959352320:0@lo:104: 00000100:00100000:0.0:1788796783.862521:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788796783.862526:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267647450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+3:16482:x1875688959352448:12345-0@lo:104: 00010000:00010000:0.0:1788796783.862533:0:14353:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2374d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe23754 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.862566:0:14353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1788796783.862571:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1788796783.862571:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267647450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+3:16482:x1875688959352448:12345-0@lo:104: Request processed in 46us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796783.862577:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788796783.862579:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd267335200/0xdd273c88cfe238ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe238d5 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796783.862586:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267335200 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:2.0:1788796783.862591:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd267335200/0xdd273c88cfe238ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe238d5 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796783.862599:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd267335200/0xdd273c88cfe238ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe238d5 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796783.862606:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd267335200/0xdd273c88cfe238ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe238d5 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796783.862612:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788796783.862650:0:14357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd267335200/0xdd273c88cfe238ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe238d5 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796783.862656:0:14357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788796783.862678:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd267335200/0xdd273c88cfe238ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe238d5 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796783.862685:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd267335200/0xdd273c88cfe238ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe238d5 expref: -99 pid: 15767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796783.862700:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788796783.862703:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe2379a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe237a1 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796783.862734:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd267334000 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:2.0:1788796783.862737:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe2379a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe237a1 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796783.862743:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe2379a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe237a1 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788796783.862774:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe2379a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe237a1 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788796783.862779:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788796783.862786:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788796783.862794:0:14357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe2379a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe237a1 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796783.862800:0:14357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788796783.862803:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1788796783.862806:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe2379a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe237a1 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796783.862811:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd267334000/0xdd273c88cfe2379a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe237a1 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796783.862814:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3307:1875688959352704:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788796783.862821:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796783.862823:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796783.862825:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796783.862841:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796783.862862:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959352704 00000100:00100000:3.0:1788796783.862863:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3307:1875688959352576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796783.862866:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959352704 00000100:00100000:3.0:1788796783.862881:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788796783.862886:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe237a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2379a expref: 19 pid: 14364 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796783.862904:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959352576 00000100:00100000:3.0:1788796783.863038:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788796783.863049:0:14356:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:3307:x1875688959352704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788796783.863060:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796783.863067:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe237a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2379a expref: 19 pid: 14364 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796783.863076:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe237a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe2379a expref: 19 pid: 14364 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796783.863089:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd247d21a00/0xdd273c88cfe237a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe2379a expref: 19 pid: 14364 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796783.863100:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796783.863129:0:14356:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:3307:x1875688959352704:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796783.863142:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788796783.863170:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3307:1875688959352704:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788796783.863226:0:16484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796783.863232:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2374d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdd273c88cfe23754 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796783.863239:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2821d5400 already unused, calling callback (ffffffffc1a59c20) 10000000:00010000:3.0:1788796783.863242:0:14358:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2374d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdd273c88cfe23754 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796783.863248:0:14358:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2374d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdd273c88cfe23754 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788796783.863254:0:14358:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2374d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdd273c88cfe23754 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788796783.863258:0:14358:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788796783.863272:0:14358:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2374d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe23754 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796783.863277:0:14358:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788796783.863292:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2374d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe23754 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796783.863297:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff9bd2821d5400/0xdd273c88cfe2374d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdd273c88cfe23754 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796783.863310:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796783.863312:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796783.863318:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796783.863323:0:16484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796783.863325:0:16484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796783.863793:0:16482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16482:1875688959352448:0@lo:104: 00000100:00100000:2.0:1788796783.863844:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959352576 00010000:00010000:2.0:1788796783.863865:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd141d5ac00/0xdd273c88cfe238d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe238ce expref: 18 pid: 14363 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796783.863892:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788796783.863897:0:14356:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788796783.863899:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:3307:x1875688959352576:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788796783.863905:0:14356:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788796783.863907:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796783.863911:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd141d5ac00/0xdd273c88cfe238d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe238ce expref: 18 pid: 14363 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796783.864058:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3304:1875688959352832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788796783.864097:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796783.864133:0:14355:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788796783.864139:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959352832 00000100:00100000:0.0:1788796783.864142:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959352832 00010000:00010000:0.0:1788796783.864155:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe23754 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2374d expref: 19 pid: 14364 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796783.864168:0:14355:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788796783.864174:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788796783.864180:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267279450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:3304:x1875688959352832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788796783.864187:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796783.864190:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe23754 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdd273c88cfe2374d expref: 19 pid: 14364 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.864198:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe23754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe2374d expref: 19 pid: 14364 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.864223:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd2821d4000/0xdd273c88cfe23754 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe2374d expref: 19 pid: 14364 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.864234:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796783.864272:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267279450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:3304:x1875688959352832:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796783.864279:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788796783.864333:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3304:1875688959352832:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788796783.864458:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd141d5ac00/0xdd273c88cfe238d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdd273c88cfe238ce expref: 17 pid: 14363 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796783.864469:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd141d5ac00/0xdd273c88cfe238d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdd273c88cfe238ce expref: 17 pid: 14363 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796783.864478:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796783.864527:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:3307:x1875688959352576:12345-0@lo:103:ldlm_bl.0 Request processed in 628us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796783.864533:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788796783.866554:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3307:1875688959352576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788796783.873257:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796783.873381:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936290688 00000100:00100000:0.0:1788796783.873393:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936290688 00010000:00010000:0.0:1788796783.873435:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe23a33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed37 expref: 13 pid: 14362 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796783.873478:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:0.0:1788796783.873487:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1166de96-7c57-41f7-a46b-7894de6a4a61+13:2358:x1875688936290688:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796783.873504:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796783.873510:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe23a33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed37 expref: 13 pid: 14362 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.873523:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe23a33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed37 expref: 13 pid: 14362 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.873543:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796783.873600:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1166de96-7c57-41f7-a46b-7894de6a4a61+13:2358:x1875688936290688:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 113us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796783.873608:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1788796783.873614:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796783.873627:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936290816 00000100:00100000:0.0:1788796783.873630:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936290816 00010000:00010000:0.0:1788796783.873641:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bd141d5bc00/0xdd273c88cfe239fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ecd5 expref: 13 pid: 14363 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796783.873676:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1788796783.873684:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1166de96-7c57-41f7-a46b-7894de6a4a61+13:2356:x1875688936290816:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796783.873694:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796783.873698:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bd141d5bc00/0xdd273c88cfe239fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ecd5 expref: 13 pid: 14363 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.873708:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bd141d5bc00/0xdd273c88cfe239fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ecd5 expref: 13 pid: 14363 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.873739:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bd14316a000/0xdd273c88cfe23a5d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.873773:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd14316a000/0xdd273c88cfe23a5d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.873789:0:14355:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd14316a000/0xdd273c88cfe23a5d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.873796:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bd14316a000/0xdd273c88cfe23a5d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.873803:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bd14316a000/0xdd273c88cfe23a5d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.873810:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bd14316a000/0xdd273c88cfe23a5d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.873817:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316a000 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796783.873821:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bd14316a000/0xdd273c88cfe23a5d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.873835:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bd14316a000/0xdd273c88cfe23a5d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.873844:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bd14316a000/0xdd273c88cfe23a5d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796783.873854:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796783.873881:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1166de96-7c57-41f7-a46b-7894de6a4a61+13:2356:x1875688936290816:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 197us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796783.873888:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00010000:00010000:1.0:1788796783.875410:0:16482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd240030e00/0xdd273c88cfe23a33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed37 expref: 12 pid: 14362 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796783.875432:0:16482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16482:1875688959351936:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796783.875446:0:16482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd141d5bc00/0xdd273c88cfe239fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ecd5 expref: 11 pid: 14363 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796783.875454:0:16482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16482:1875688959352064:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796783.875483:0:16482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bd14316a000/0xdd273c88cfe23a5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796783.875491:0:16482:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bd14316a000/0xdd273c88cfe23a5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796783.875496:0:16482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bd14316a000/0xdd273c88cfe23a5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796783.875502:0:16482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bd14316a000/0xdd273c88cfe23a5d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796784.345983:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788796785.181477:0:14367:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788796785.181487:0:14367:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd249c10000 from 10 10000000:01000000:2.0:1788796785.181493:0:14367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788796785.181551:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6400/0xdd273c88cfe23a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796785.181565:0:14367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6400/0xdd273c88cfe23a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796785.181667:0:14367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6400/0xdd273c88cfe23a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796785.181705:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959352960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788796785.181913:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796785.185514:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd2794e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1788796785.191375:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959352960 00000100:00100000:0.0:1788796785.191394:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959352960 00000100:00100000:1.0:1788796785.191571:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788796785.191593:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+16:14367:x1875688959352960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796785.191621:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796785.191642:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd14316b600/0xdd273c88cfe23a6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe23a64 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.191670:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd14316b600/0xdd273c88cfe23a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe23a64 expref: 17 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.191680:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd14316b600/0xdd273c88cfe23a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe23a64 expref: 17 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.191702:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd14316b600, rc 0) 00000100:00100000:1.0:1788796785.191809:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:14367:x1875688959352960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (9897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796785.191816:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788796785.191870:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959352960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796785.191888:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6400/0xdd273c88cfe23a64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23a6b expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.191898:0:14367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6400/0xdd273c88cfe23a64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe23a6b expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796785.191963:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.191994:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796785.192021:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26c676f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788796785.192034:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959353088 00000100:00100000:1.0:1788796785.192037:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959353088 00000100:00100000:1.0:1788796785.192059:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788796785.192065:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:14367:x1875688959353088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.192297:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:14367:x1875688959353088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796785.192304:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788796785.192333:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.192358:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.192392:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796785.192405:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26c676f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788796785.192415:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959353216 00000100:00100000:1.0:1788796785.192418:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959353216 00000100:00100000:1.0:1788796785.192436:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788796785.192442:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:14367:x1875688959353216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.192588:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:14367:x1875688959353216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796785.192595:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788796785.192630:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788796785.193338:0:16529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788796785.193397:0:14367:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788796785.193414:0:14367:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788796785.193422:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6400/0xdd273c88cfe23a64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23a6b expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.193433:0:14367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd2466b6400/0xdd273c88cfe23a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23a6b expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796785.193443:0:14367:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788796785.193454:0:14367:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd25020a800 from 10 10000000:01000000:1.0:1788796785.193458:0:14367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788796785.193482:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd14316a800/0xdd273c88cfe23a72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.193491:0:14367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd14316a800/0xdd273c88cfe23a72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.193500:0:14367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd14316a800/0xdd273c88cfe23a72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796785.193516:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.193549:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796785.193567:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26c676c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788796785.193580:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959353344 00000100:00100000:1.0:1788796785.193584:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959353344 00000100:00100000:1.0:1788796785.193609:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788796785.193615:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+17:14367:x1875688959353344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796785.193623:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796785.193634:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd14316b800/0xdd273c88cfe23a79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe23a72 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.193652:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd14316b800/0xdd273c88cfe23a79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe23a72 expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.193661:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd14316b800/0xdd273c88cfe23a79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe23a72 expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.193668:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd14316b800, rc 0) 00000100:00100000:1.0:1788796785.193707:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:14367:x1875688959353344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796785.193719:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788796785.193775:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796785.193786:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd14316a800/0xdd273c88cfe23a72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23a79 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.193794:0:14367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd14316a800/0xdd273c88cfe23a72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe23a79 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796785.193829:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.193850:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796785.193862:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26c676c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788796785.193871:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959353472 00000100:00100000:1.0:1788796785.193873:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959353472 00000100:00100000:1.0:1788796785.193891:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788796785.193896:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:14367:x1875688959353472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.194082:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:14367:x1875688959353472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796785.194088:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788796785.194115:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.194136:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.194168:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796785.194181:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26c676c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788796785.194192:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959353600 00000100:00100000:1.0:1788796785.194196:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959353600 00000100:00100000:1.0:1788796785.194215:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788796785.194227:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:14367:x1875688959353600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.194342:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:14367:x1875688959353600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796785.194348:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788796785.194381:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788796785.201082:0:16530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788796785.207810:0:14367:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788796785.207848:0:14367:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788796785.207861:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd14316a800/0xdd273c88cfe23a72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23a79 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.207874:0:14367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd14316a800/0xdd273c88cfe23a72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23a79 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788796785.207884:0:14367:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788796785.207887:0:14367:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9bd27e170800 from 10 10000000:01000000:1.0:1788796785.207889:0:14367:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788796785.207929:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd14316bc00/0xdd273c88cfe23a80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.207937:0:14367:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff9bd14316bc00/0xdd273c88cfe23a80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.207949:0:14367:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff9bd14316bc00/0xdd273c88cfe23a80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796785.207975:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.208046:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796785.208129:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26c676c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788796785.211680:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959353728 00000100:00100000:2.0:1788796785.211706:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959353728 00000100:00100000:1.0:1788796785.217991:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788796785.218006:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+18:14367:x1875688959353728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796785.218026:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796785.218048:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd14316a600/0xdd273c88cfe23a87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdd273c88cfe23a80 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.218083:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd14316a600/0xdd273c88cfe23a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdd273c88cfe23a80 expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.218094:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd14316a600/0xdd273c88cfe23a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdd273c88cfe23a80 expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.218103:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd14316a600, rc 0) 00000100:00100000:1.0:1788796785.218191:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:14367:x1875688959353728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (10144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796785.218198:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788796785.218273:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788796785.218293:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff9bd14316bc00/0xdd273c88cfe23a80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23a87 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796785.218304:0:14367:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff9bd14316bc00/0xdd273c88cfe23a80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdd273c88cfe23a87 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796785.218377:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.218416:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796785.218460:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26c676c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796785.219295:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959353856 00000100:00100000:3.0:1788796785.219306:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959353856 00000100:00100000:3.0:1788796785.219351:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788796785.219360:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:14367:x1875688959353856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796785.219652:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:14367:x1875688959353856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796785.219660:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788796785.219719:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796785.219784:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788796785.219837:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796785.219871:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd245e1b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788796785.220350:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959353984 00000100:00100000:1.0:1788796785.220357:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959353984 00000100:00100000:1.0:1788796785.220403:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788796785.220411:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:14367:x1875688959353984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.220569:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:14367:x1875688959353984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796785.220576:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788796785.220706:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cc080b8f-c449-46a7-a564-69e1c33bc9a6:14367:1875688959353984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788796785.222151:0:16533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788796785.222471:0:14367:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788796785.222494:0:14367:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788796785.222505:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff9bd14316bc00/0xdd273c88cfe23a80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23a87 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796785.222516:0:14367:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff9bd14316bc00/0xdd273c88cfe23a80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdd273c88cfe23a87 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796785.373544:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796785.677782:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796785.677821:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936290944 00000100:00100000:2.0:1788796785.677831:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936290944 00000100:00100000:2.0:1788796785.677894:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:2.0:1788796785.677904:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+11:13735:x1875688936290944:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788796785.677921:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796785.677939:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd2466b7600/0xdd273c88cfe23a8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ed68 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796785.677969:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd2466b7600/0xdd273c88cfe23a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed68 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796785.677981:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd2466b7600/0xdd273c88cfe23a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed68 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796785.677992:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7600, rc 0) 00000100:00100000:2.0:1788796785.678048:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+12:13735:x1875688936290944:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 145us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796785.678054:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:2.0:1788796785.685631:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796785.687247:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936291072 00000100:00100000:3.0:1788796785.687265:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936291072 00000100:00100000:3.0:1788796785.687331:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:3.0:1788796785.687342:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+12:13735:x1875688936291072:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788796785.687632:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+12:13735:x1875688936291072:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 290us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796785.687640:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:3.0:1788796785.691469:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796785.692997:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936291200 00000100:00100000:1.0:1788796785.693011:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936291200 00000100:00100000:1.0:1788796785.693071:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00100000:1.0:1788796785.693082:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2491e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+12:13735:x1875688936291200:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.693311:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2491e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+12:13735:x1875688936291200:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 229us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796785.693319:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00100000:2.0:1788796785.712291:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796785.712491:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936291328 00000100:00100000:3.0:1788796785.712503:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936291328 00000100:00100000:3.0:1788796785.712572:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 118 00000100:00100000:3.0:1788796785.712583:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+12:13735:x1875688936291328:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788796785.712602:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796785.712622:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bd240031a00/0xdd273c88cfe23a95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ed6f expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796785.712651:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bd240031a00/0xdd273c88cfe23a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed6f expref: 13 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796785.712662:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bd240031a00/0xdd273c88cfe23a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed6f expref: 13 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796785.712671:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240031a00, rc 0) 00000100:00100000:3.0:1788796785.712763:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+13:13735:x1875688936291328:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 161us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796785.712785:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 118 00000100:00100000:3.0:1788796785.718661:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796785.718902:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936291456 00000100:00100000:1.0:1788796785.718914:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936291456 00000100:00100000:1.0:1788796785.718984:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 119 00000100:00100000:1.0:1788796785.718994:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+13:13735:x1875688936291456:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.719460:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1166de96-7c57-41f7-a46b-7894de6a4a61+13:13735:x1875688936291456:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 465us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796785.719468:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 119 00000100:00100000:3.0:1788796785.721822:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796785.721967:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936291584 00000100:00100000:1.0:1788796785.721976:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936291584 00000100:00100000:1.0:1788796785.722026:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:1.0:1788796785.722036:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+13:13735:x1875688936291584:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788796785.722246:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+13:13735:x1875688936291584:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 211us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796785.722262:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 120 00010000:00010000:2.0:1788796786.402075:0:16484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788796786.569968:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796786.570009:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796786.570042:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796786.570065:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796786.570138:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796786.570158:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796786.570180:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796786.570209:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936291968 00000100:00100000:1.0:1788796786.570220:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936291968 00000100:00100000:1.0:1788796786.570276:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936292480 00000100:00100000:1.0:1788796786.570279:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936292480 00000100:00100000:1.0:1788796786.570290:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936292096 00000100:00100000:1.0:1788796786.570292:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936292096 00000100:00100000:1.0:1788796786.570307:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936292352 00000100:00100000:1.0:1788796786.570309:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936292352 00000100:00100000:1.0:1788796786.570328:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:1.0:1788796786.570341:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+5:2357:x1875688936291968:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796786.570395:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936291712 00000100:00100000:3.0:1788796786.570402:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936291712 00000100:00100000:1.0:1788796786.570433:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+5:2357:x1875688936291968:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 95us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796786.570443:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:1.0:1788796786.570444:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:3.0:1788796786.570457:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+13:2357:x1875688936291712:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796786.570470:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:1.0:1788796786.570479:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebcda21d-22f8-459b-b210-3710c508852e+5:2357:x1875688936292480:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788796786.570492:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1166de96-7c57-41f7-a46b-7894de6a4a61+13:2357:x1875688936291712:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 38us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796786.570500:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:1.0:1788796786.570512:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebcda21d-22f8-459b-b210-3710c508852e+5:2357:x1875688936292480:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 33us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796786.570519:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:1.0:1788796786.570550:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:1.0:1788796786.570558:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+5:2357:x1875688936292096:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796786.570587:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+5:2357:x1875688936292096:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 30us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796786.570593:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:1.0:1788796786.570605:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:1.0:1788796786.570611:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebcda21d-22f8-459b-b210-3710c508852e+5:2357:x1875688936292352:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796786.570633:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ebcda21d-22f8-459b-b210-3710c508852e+5:2357:x1875688936292352:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 22us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796786.570639:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:1.0:1788796786.570659:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936292224 00000100:00100000:1.0:1788796786.570675:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936292224 00000100:00100000:1.0:1788796786.570712:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936291840 00000100:00100000:1.0:1788796786.570716:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936291840 00000100:00100000:1.0:1788796786.570739:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:1.0:1788796786.570763:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebcda21d-22f8-459b-b210-3710c508852e+6:2357:x1875688936292224:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796786.570803:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebcda21d-22f8-459b-b210-3710c508852e+6:2357:x1875688936292224:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 58us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796786.570809:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:1.0:1788796786.570824:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:1.0:1788796786.570832:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:2357:x1875688936291840:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796786.570855:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:2357:x1875688936291840:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 24us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796786.570860:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00080000:1.0:1788796786.570899:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788796786.570905:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788796786.570908:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788796787.037040:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959354112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788796787.037163:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796787.037298:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959354112 00000100:00100000:1.0:1788796787.037308:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959354112 00000100:00100000:1.0:1788796787.037377:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788796787.037387:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959354112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796787.037420:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796787.037487:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959354112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796787.037494:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788796787.038262:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788796787.038310:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959354112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788796787.418509:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796787.548085:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959354624:0@lo:400:kworker.0 00000100:00100000:2.0:1788796787.548163:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796787.548250:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788796787.548256:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959354496:0@lo:400:kworker.0 00000100:00100000:2.0:1788796787.548280:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796787.548309:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959354624 00000100:00100000:2.0:1788796787.548316:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959354624 00000100:00100000:2.0:1788796787.548376:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959354496 00000100:00100000:2.0:1788796787.548378:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959354496 00000100:00100000:2.0:1788796787.548398:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788796787.548405:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959354624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796787.548451:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875688959354624:12345-0@lo:400:kworker.0 Request processed in 46us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796787.548457:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788796787.548473:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788796787.548479:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959354496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796787.548512:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875688959354496:12345-0@lo:400:kworker.0 Request processed in 33us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796787.548517:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788796787.548545:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796787.548570:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875688959354496:0@lo:400:kworker.0 00000100:00100000:2.0:1788796787.548580:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875688959354624:0@lo:400:kworker.0 00000100:00100000:3.0:1788796787.548932:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959354368:0@lo:400:kworker.0 00000100:00100000:3.0:1788796787.548963:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796787.549009:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959354880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788796787.549033:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796787.549049:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788796787.549054:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3307:1875688959354240:0@lo:400:kworker.0 00000100:00100000:3.0:1788796787.549079:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796787.549099:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959354752:0@lo:400:kworker.0 00000100:00100000:3.0:1788796787.549117:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788796787.549138:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959354752 00000100:00100000:3.0:1788796787.549143:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959354752 00000100:00100000:3.0:1788796787.549189:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788796787.549197:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959354752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796787.549232:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875688959354752:12345-0@lo:400:kworker.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796787.549245:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788796787.549265:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959354240 00000100:00100000:3.0:1788796787.549269:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959354240 00000100:00100000:3.0:1788796787.549298:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788796787.549304:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:3307:x1875688959354240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788796787.549333:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:3307:x1875688959354240:12345-0@lo:400:kworker.0 Request processed in 30us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796787.549351:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1788796787.549382:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788796787.549399:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3307:1875688959354240:0@lo:400:kworker.0 00000100:00100000:3.0:1788796787.549411:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875688959354752:0@lo:400:kworker.0 00000100:00100000:1.0:1788796787.549491:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959354880 00000100:00100000:1.0:1788796787.549497:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959354880 00000100:00100000:1.0:1788796787.549541:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788796787.549549:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959354880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796787.549575:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796787.549621:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959354880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796787.549627:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788796787.549673:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959354880:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788796787.549831:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788796787.550439:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959354368 00000100:00100000:2.0:1788796787.550446:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959354368 00000100:00100000:2.0:1788796787.550501:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788796787.550509:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959354368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796787.550559:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875688959354368:12345-0@lo:400:kworker.0 Request processed in 52us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796787.550565:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788796787.550610:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959354368:0@lo:400:kworker.0 00000100:00100000:3.0:1788796788.330682:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796788.330928:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936292608 00000100:00100000:0.0:1788796788.330943:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936292608 00000100:00100000:0.0:1788796788.331048:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:0.0:1788796788.331065:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:14393:x1875688936292608:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788796788.331090:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796788.331141:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a400/0xdd273c88cfe23a9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ed76 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.331236:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23aa3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.331254:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.331269:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.331320:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23aaa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.331329:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23aaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.331336:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23aaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332400:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a600/0xdd273c88cfe23ab1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332418:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a600/0xdd273c88cfe23ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332428:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a600/0xdd273c88cfe23ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796788.332461:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788796788.332465:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000100:00080000:3.0:1788796788.332586:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1788796788.332743:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a600/0xdd273c88cfe23ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332778:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332786:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23aa3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332793:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332815:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd141d5b800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796788.332820:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332829:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23aa3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332844:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:0.0:1788796788.332848:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796788.332855:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23aa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332861:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23aa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332877:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23aaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332883:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23aaa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332889:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23aaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332893:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd141d5b600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796788.332895:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23aaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332901:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23aaa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332919:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bd25296d000) 00010000:00010000:0.0:1788796788.332922:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796788.332925:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23aaa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332931:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23aaa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332982:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a400/0xdd273c88cfe23a9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed76 expref: 8 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.332998:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a600/0xdd273c88cfe23ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed76 expref: 7 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.333007:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd25296d800) 00010000:00010000:0.0:1788796788.333010:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788796788.333012:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5a600, rc 0) 00000100:00100000:0.0:1788796788.337859:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+7:14393:x1875688936292608:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 6782us (7174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796788.337873:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:1.0:1788796788.346143:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796788.346340:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936292864 00000100:00100000:2.0:1788796788.346366:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936292864 00000100:00100000:2.0:1788796788.346445:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:2.0:1788796788.346457:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+7:14393:x1875688936292864:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788796788.346481:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796788.346505:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23ab8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ed7d expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.346584:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7800/0xdd273c88cfe23abf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.346601:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7800/0xdd273c88cfe23abf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.346613:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7800/0xdd273c88cfe23abf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.346675:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23ac6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.346684:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.346692:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347137:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe23acd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347146:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe23acd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347153:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe23acd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796788.347165:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788796788.347362:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7800/0xdd273c88cfe23abf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347371:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7800/0xdd273c88cfe23abf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347378:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7800/0xdd273c88cfe23abf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347384:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796788.347389:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7800/0xdd273c88cfe23abf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347406:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7800/0xdd273c88cfe23abf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347419:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bd25296d800) 00010000:00010000:2.0:1788796788.347422:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796788.347428:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7800/0xdd273c88cfe23abf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347434:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7800/0xdd273c88cfe23abf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347447:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347454:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347461:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347466:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796788.347469:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347474:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347481:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bd24d573400) 00010000:00010000:2.0:1788796788.347484:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796788.347486:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23ac6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.347502:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23ac6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.348063:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23ab8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed7d expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.348081:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6c00/0xdd273c88cfe23acd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed7d expref: 9 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.348088:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd24d573f00) 00010000:00010000:2.0:1788796788.348091:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796788.348094:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b6c00, rc 0) 00000100:00100000:2.0:1788796788.348181:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+9:14393:x1875688936292864:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1726us (2058us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788796788.348191:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788796788.362922:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796788.363348:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936292992 00000100:00100000:2.0:1788796788.363363:0:15986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936292992 00000100:00100000:2.0:1788796788.363433:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:2.0:1788796788.363444:0:15986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+9:14393:x1875688936292992:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788796788.363571:0:15986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+9:14393:x1875688936292992:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 Request processed in 128us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796788.363579:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:3.0:1788796788.405617:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796788.405700:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936293120 00000100:00100000:0.0:1788796788.405714:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936293120 00000100:00100000:0.0:1788796788.405805:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:0.0:1788796788.405817:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+9:14399:x1875688936293120:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788796788.405841:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796788.405867:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a400/0xdd273c88cfe23adb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ed84 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.405968:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23ae2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.405984:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.405998:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406013:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23ae9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406020:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406027:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406242:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406251:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23ae2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406258:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406264:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd141d5b600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796788.406269:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406428:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23ae2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406445:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:0.0:1788796788.406449:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796788.406457:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23ae2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406463:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23ae2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406478:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406485:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23ae9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406492:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406497:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd141d5b800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796788.406500:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406507:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406513:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd25296d000) 00010000:00010000:0.0:1788796788.406516:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796788.406518:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23ae9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406534:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23ae9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406568:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a400/0xdd273c88cfe23adb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed84 expref: 10 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406579:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:0.0:1788796788.406582:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796788.406585:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a400/0xdd273c88cfe23adb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed84 expref: 10 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.406595:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5a400, rc 0) 00000100:00100000:0.0:1788796788.406710:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+9:14399:x1875688936293120:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 895us (1104us total) trans 0 rc 301/301 00000100:00100000:0.0:1788796788.406719:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:1.0:1788796788.414471:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796788.416448:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936293248 00000100:00100000:0.0:1788796788.416464:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936293248 00000100:00100000:0.0:1788796788.416607:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:0.0:1788796788.416619:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+9:14399:x1875688936293248:12345-192.168.201.25@tcp:700:lfs.0 00000100:00100000:0.0:1788796788.416739:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+9:14399:x1875688936293248:12345-192.168.201.25@tcp:700:lfs.0 Request processed in 123us (2278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796788.416763:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:1.0:1788796788.421199:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796788.421490:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936293504 00000100:00100000:2.0:1788796788.421502:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936293504 00000100:00100000:2.0:1788796788.421575:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:2.0:1788796788.421587:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+9:14399:x1875688936293504:12345-192.168.201.25@tcp:36:lfs.0 00010000:00010000:2.0:1788796788.421677:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796788.421709:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23a1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ecff expref: 9 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.421733:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:2.0:1788796788.421740:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788796788.422007:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23af0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.422021:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a800/0xdd273c88cfe23a56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed61 expref: 5 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.422030:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23af0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.422064:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a800/0xdd273c88cfe23a56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed61 expref: 5 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.422079:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a800/0xdd273c88cfe23a56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed61 expref: 5 pid: 15986 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796788.422092:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd2671bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875688959355008:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796788.422202:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247daa900 going to sleep for 11 seconds 00000100:00100000:1.0:1788796788.424867:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796788.424973:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936293632 00000100:00100000:3.0:1788796788.424985:0:14356:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936293632 00000100:00100000:2.0:1788796788.425041:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd2671bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875688959355008:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788796788.425052:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a800/0xdd273c88cfe23a56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed61 expref: 6 pid: 15986 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.425074:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23af0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796788.425102:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1788796788.425114:0:14356:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ebcda21d-22f8-459b-b210-3710c508852e+6:2357:x1875688936293632:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796788.425129:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1788796788.425132:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788796788.425138:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a800/0xdd273c88cfe23a56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed61 expref: 6 pid: 15986 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796788.425169:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a800/0xdd273c88cfe23a56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed61 expref: 6 pid: 15986 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796788.425193:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5a800/0xdd273c88cfe23a56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed61 expref: 6 pid: 15986 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796788.425210:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:3.0:1788796788.425216:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23af0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796788.425226:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23af0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796788.425234:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23af0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796788.425265:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796788.425328:0:14356:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267307b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ebcda21d-22f8-459b-b210-3710c508852e+5:2357:x1875688936293632:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 216us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796788.425336:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00010000:00010000:2.0:1788796788.425600:0:14370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23af0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.425616:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23af0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.425648:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23af7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.425657:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23af7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.425667:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23af7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796788.431197:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788796788.431221:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23af0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.431232:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23af0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.431240:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23af0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.431246:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796788.431251:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23af0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.431258:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23af0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.431274:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bd00) 00010000:00010000:2.0:1788796788.431277:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796788.431369:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23af0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.431376:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23af0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788796788.431401:0:14370:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000907648b0 reply state 00000000e93ee076 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23af7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796788.431410:0:14370:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788796788.431566:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+10:14399:x1875688936293504:12345-192.168.201.25@tcp:36:lfs.0 Request processed in 9976us (10374us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788796788.431575:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00010000:00010000:2.0:1788796788.436817:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23af7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.436838:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23af7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.436847:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23af7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.436853:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796788.436858:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23af7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.436866:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23af7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.436884:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd24d573400) 00010000:00010000:2.0:1788796788.436887:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796788.436892:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23af7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.436912:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23af7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796788.441938:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796788.547599:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796788.547673:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936293760 00000100:00100000:3.0:1788796788.547685:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936293760 00000100:00100000:3.0:1788796788.547792:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:3.0:1788796788.547805:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+9:14407:x1875688936293760:12345-192.168.201.25@tcp:101:lctl.0 00010000:00010000:3.0:1788796788.547842:0:16253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796788.547866:0:16253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030400/0xdd273c88cfe23afe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ed8b expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.548020:0:16253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23b05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.548105:0:16253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.548119:0:16253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796788.548154:0:16253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788796788.548159:0:16253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788796788.548214:0:16253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.548240:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030400/0xdd273c88cfe23afe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed8b expref: 11 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.548270:0:16253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7200/0xdd273c88cfe23b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed8b expref: 10 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.548343:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:2.0:1788796788.548349:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788796788.548354:0:16253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7200, rc 0) 00000100:00100000:2.0:1788796788.548420:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+10:14407:x1875688936293760:12345-192.168.201.25@tcp:101:lctl.0 Request processed in 618us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796788.548427:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:1.0:1788796788.580859:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796788.580986:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936293888 00000100:00100000:0.0:1788796788.580997:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936293888 00000100:00100000:0.0:1788796788.581060:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:0.0:1788796788.581067:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebcda21d-22f8-459b-b210-3710c508852e+5:14408:x1875688936293888:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788796788.581086:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796788.581103:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ed92 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.581155:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23b13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.581166:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23b13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.581175:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23b13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796788.581202:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788796788.581205:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788796788.581221:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23b13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.581238:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed92 expref: 7 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.581252:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b600/0xdd273c88cfe23b13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed92 expref: 6 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.581258:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:0.0:1788796788.581260:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788796788.581263:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5b600, rc 0) 00000100:00100000:0.0:1788796788.581336:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ebcda21d-22f8-459b-b210-3710c508852e+6:14408:x1875688936293888:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 269us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796788.581347:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:3.0:1788796788.583887:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796788.584308:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936294016 00000100:00100000:2.0:1788796788.584318:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936294016 00000100:00100000:2.0:1788796788.584376:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:2.0:1788796788.584387:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebcda21d-22f8-459b-b210-3710c508852e+6:14408:x1875688936294016:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788796788.584408:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796788.584431:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7800/0xdd273c88cfe23b1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ed99 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584510:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23b21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584528:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23b21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584541:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23b21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584557:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe23b28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584564:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe23b28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584570:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe23b28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584734:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe23b2f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584741:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe23b2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584792:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe23b2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796788.584824:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788796788.584827:0:14370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788796788.584845:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe23b2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584858:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23b21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584865:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23b21 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584872:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23b21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584878:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b6a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796788.584882:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23b21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584888:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23b21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584898:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:2.0:1788796788.584900:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796788.584904:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23b21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584908:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b6a00/0xdd273c88cfe23b21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584926:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe23b28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584930:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe23b28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584934:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe23b28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584937:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796788.584938:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe23b28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584941:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe23b28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584945:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd24d573400) 00010000:00010000:2.0:1788796788.584947:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796788.584948:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe23b28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584951:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7a00/0xdd273c88cfe23b28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584976:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7800/0xdd273c88cfe23b1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed99 expref: 8 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584984:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe23b2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed99 expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.584996:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd24d573000) 00010000:00010000:2.0:1788796788.584998:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788796788.584999:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd2466b7c00, rc 0) 00000100:00100000:2.0:1788796788.585055:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebcda21d-22f8-459b-b210-3710c508852e+7:14408:x1875688936294016:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 670us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796788.585062:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:2.0:1788796788.588566:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796788.588674:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936294272 00000100:00100000:0.0:1788796788.588684:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936294272 00000100:00100000:0.0:1788796788.588836:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:0.0:1788796788.588849:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ebcda21d-22f8-459b-b210-3710c508852e+7:14408:x1875688936294272:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788796788.588871:0:16253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796788.588892:0:16253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eda0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796788.588990:0:16253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788796788.589128:0:16253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b36 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eda0 expref: 9 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.589143:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:0.0:1788796788.589146:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788796788.589152:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eda0 expref: 9 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.589166:0:16253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5b800, rc 0) 00000100:00100000:0.0:1788796788.589225:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ebcda21d-22f8-459b-b210-3710c508852e+8:14408:x1875688936294272:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 380us (670us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788796788.589232:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:1.0:1788796788.591843:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796788.593554:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936294528 00000100:00100000:2.0:1788796788.593574:0:15986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936294528 00000100:00100000:2.0:1788796788.593657:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:2.0:1788796788.593668:0:15986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebcda21d-22f8-459b-b210-3710c508852e+8:14408:x1875688936294528:12345-192.168.201.25@tcp:36:lfs.0 00010000:00010000:2.0:1788796788.593740:0:15986:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796788.593785:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7c00/0xdd273c88cfe23b2f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ed99 expref: 8 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.593818:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd24d573000) 00010000:00010000:2.0:1788796788.593831:0:15986:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788796788.593858:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23b44 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.593872:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23b44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.593885:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23b44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788796788.594108:0:15986:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b401b5f1 reply state 000000003f3e503f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23b44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796788.594130:0:15986:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788796788.594139:0:15986:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788796788.594226:0:15986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebcda21d-22f8-459b-b210-3710c508852e+9:14408:x1875688936294528:12345-192.168.201.25@tcp:36:lfs.0 Request processed in 559us (2403us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788796788.594233:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:3.0:1788796788.599956:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:2.0:1788796788.600089:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23b44 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.600104:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23b44 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.600111:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23b44 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.600117:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd2466b7e00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796788.600121:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23b44 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.600128:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23b44 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.600144:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd24d573d00) 00010000:00010000:2.0:1788796788.600147:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788796788.600153:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23b44 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.600158:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd2466b7e00/0xdd273c88cfe23b44 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796788.600704:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936294784 00000100:00100000:0.0:1788796788.600713:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936294784 00000100:00100000:0.0:1788796788.600796:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:0.0:1788796788.600807:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebcda21d-22f8-459b-b210-3710c508852e+8:14408:x1875688936294784:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:0.0:1788796788.601072:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebcda21d-22f8-459b-b210-3710c508852e+9:14408:x1875688936294784:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 266us (1124us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788796788.601080:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:2.0:1788796788.609728:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796788.609952:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936295040 00000100:00100000:1.0:1788796788.609963:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936295040 00000100:00100000:1.0:1788796788.610024:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:1.0:1788796788.610035:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebcda21d-22f8-459b-b210-3710c508852e+9:14408:x1875688936295040:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796788.610063:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796788.610091:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316ac00/0xdd273c88cfe23b4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eda7 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610176:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610191:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610205:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610219:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23b59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610226:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610233:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796788.610355:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788796788.610464:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610472:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610500:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610506:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316b000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796788.610510:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610518:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610530:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:1.0:1788796788.610533:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796788.610538:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610545:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610560:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610566:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23b59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610572:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23b59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610577:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316b400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796788.610580:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23b59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610597:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23b59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610605:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd24943d100) 00010000:00010000:1.0:1788796788.610607:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796788.610611:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23b59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610617:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23b59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610667:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316ac00/0xdd273c88cfe23b4b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eda7 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610678:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:1.0:1788796788.610680:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796788.610684:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316ac00/0xdd273c88cfe23b4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eda7 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.610694:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd14316ac00, rc 0) 00000100:00100000:1.0:1788796788.610775:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ebcda21d-22f8-459b-b210-3710c508852e+10:14408:x1875688936295040:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 742us (1060us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788796788.610783:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:1.0:1788796788.615130:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796788.615244:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936295168 00000100:00100000:0.0:1788796788.615256:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936295168 00000100:00100000:0.0:1788796788.615322:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:0.0:1788796788.615333:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ebcda21d-22f8-459b-b210-3710c508852e+10:14408:x1875688936295168:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788796788.615361:0:16253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796788.615396:0:16253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5aa00/0xdd273c88cfe23b67 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65edae expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.615664:0:16253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23b6e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.615678:0:16253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23b6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.615691:0:16253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23b6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796788.615716:0:16253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788796788.615720:0:16253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788796788.615738:0:16253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23b6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.615802:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5aa00/0xdd273c88cfe23b67 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edae expref: 12 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.615820:0:16253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23b6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edae expref: 11 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.615947:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd25296d000) 00010000:00010000:0.0:1788796788.615950:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788796788.615953:0:16253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5b200, rc 0) 00000100:00100000:0.0:1788796788.616009:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ebcda21d-22f8-459b-b210-3710c508852e+11:14408:x1875688936295168:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 678us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796788.616016:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:3.0:1788796788.623509:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796788.623684:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936295296 00000100:00100000:0.0:1788796788.623695:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936295296 00000100:00100000:0.0:1788796788.623781:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:0.0:1788796788.623803:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebcda21d-22f8-459b-b210-3710c508852e+11:14408:x1875688936295296:12345-192.168.201.25@tcp:37:lfs.0 00000100:00100000:0.0:1788796788.629585:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ebcda21d-22f8-459b-b210-3710c508852e+11:14408:x1875688936295296:12345-192.168.201.25@tcp:37:lfs.0 Request processed in 5780us (6072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796788.629599:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:1.0:1788796788.632620:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796788.632774:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936295552 00000100:00100000:3.0:1788796788.632786:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936295552 00000100:00100000:3.0:1788796788.632854:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:3.0:1788796788.632864:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eaf2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ebcda21d-22f8-459b-b210-3710c508852e+11:14408:x1875688936295552:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788796788.633121:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eaf2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ebcda21d-22f8-459b-b210-3710c508852e+12:14408:x1875688936295552:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 258us (512us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788796788.633130:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:3.0:1788796788.697236:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796788.697358:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936295680 00000100:00100000:1.0:1788796788.697382:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936295680 00000100:00100000:1.0:1788796788.697452:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:1.0:1788796788.697493:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+10:14414:x1875688936295680:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796788.697523:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796788.697549:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23b75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65edb5 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.697624:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.697651:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.697663:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.697677:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23b83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.697684:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23b83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.697691:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23b83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.697988:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316be00/0xdd273c88cfe23b8a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.697998:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316be00/0xdd273c88cfe23b8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698006:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316be00/0xdd273c88cfe23b8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796788.698046:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788796788.698050:0:14371:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796788.698095:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316be00/0xdd273c88cfe23b8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698107:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698115:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698122:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698128:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316b000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796788.698132:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698139:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698151:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:1.0:1788796788.698154:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796788.698159:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698164:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23b7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698177:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23b83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698192:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23b83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698198:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23b83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698203:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316a200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796788.698205:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23b83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698212:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23b83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698218:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bd24943d100) 00010000:00010000:1.0:1788796788.698220:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796788.698223:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23b83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698228:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23b83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698256:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23b75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edb5 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698269:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316be00/0xdd273c88cfe23b8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edb5 expref: 11 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.698276:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd25296d000) 00010000:00010000:1.0:1788796788.698279:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788796788.698285:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd14316be00, rc 0) 00000100:00100000:1.0:1788796788.698518:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+11:14414:x1875688936295680:12345-192.168.201.25@tcp:101:bash.0 Request processed in 1040us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796788.698526:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:2.0:1788796788.705300:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796788.705399:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936295936 00000100:00100000:3.0:1788796788.705411:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936295936 00000100:00100000:0.0:1788796788.705619:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:0.0:1788796788.705643:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+11:14414:x1875688936295936:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1788796788.705667:0:16253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796788.705689:0:16253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5aa00/0xdd273c88cfe23b91 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65edbc expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.705868:0:16253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b98 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.705884:0:16253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23b6e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edae expref: 11 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.705915:0:16253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b98 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.705959:0:16253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23b6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edae expref: 11 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.705974:0:16253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23b6e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edae expref: 11 pid: 16253 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796788.705990:0:16253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e845180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16253:1875688959355136:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788796788.706223:0:16253:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd250d48480 going to sleep for 11 seconds 00000100:00100000:3.0:1788796788.709327:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796788.709498:0:16485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936296064 00000100:00100000:1.0:1788796788.709509:0:16485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936296064 00010000:00010000:1.0:1788796788.709552:0:16485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23b6e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edae expref: 12 pid: 16253 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796788.709597:0:16485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:1.0:1788796788.709607:0:16485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27b4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ebcda21d-22f8-459b-b210-3710c508852e+12:2357:x1875688936296064:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788796788.709623:0:16485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796788.709660:0:16485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23b6e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edae expref: 12 pid: 16253 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.709675:0:16485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23b6e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edae expref: 12 pid: 16253 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.709697:0:16485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd25296d000) 00010000:00010000:1.0:1788796788.709702:0:16485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b98 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.709713:0:16485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.709721:0:16485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b98 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.709741:0:16485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788796788.709852:0:16485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27b4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ebcda21d-22f8-459b-b210-3710c508852e+12:2357:x1875688936296064:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 245us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796788.709860:0:16485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00010000:00010000:0.0:1788796788.711179:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23b6e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edae expref: 11 pid: 16253 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796788.711207:0:16253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e845180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16253:1875688959355136:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796788.711232:0:16253:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.711244:0:16253:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.711250:0:16253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.711277:0:16253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5be00/0xdd273c88cfe23b9f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.711287:0:16253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5be00/0xdd273c88cfe23b9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.711307:0:16253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5be00/0xdd273c88cfe23b9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.713153:0:16253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5bc00/0xdd273c88cfe23ba6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.713175:0:16253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5bc00/0xdd273c88cfe23ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.713187:0:16253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5bc00/0xdd273c88cfe23ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796788.713200:0:16253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788796788.713233:0:16253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.713240:0:16253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b98 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.713247:0:16253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b98 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.713253:0:16253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd141d5b800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796788.713258:0:16253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b98 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.713267:0:16253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b98 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.713280:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd25296d000) 00010000:00010000:0.0:1788796788.713283:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796788.713300:0:16253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b98 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.713308:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23b98 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788796788.713323:0:16253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cebf078 reply state 000000007ebb3f5b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5be00/0xdd273c88cfe23b9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796788.713332:0:16253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788796788.713647:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5aa00/0xdd273c88cfe23b91 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edbc expref: 14 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.713667:0:16253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5bc00/0xdd273c88cfe23ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edbc expref: 13 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.713674:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:0.0:1788796788.713676:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788796788.713679:0:16253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5bc00, rc 0) 00000100:00100000:0.0:1788796788.713864:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+14:14414:x1875688936295936:12345-192.168.201.25@tcp:101:bash.0 Request processed in 8234us (8576us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788796788.713873:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00010000:00010000:2.0:1788796788.721641:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5be00/0xdd273c88cfe23b9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.721663:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5be00/0xdd273c88cfe23b9f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.721672:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5be00/0xdd273c88cfe23b9f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.721679:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd141d5be00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796788.721685:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5be00/0xdd273c88cfe23b9f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.721695:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5be00/0xdd273c88cfe23b9f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.721715:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bd25296de00) 00010000:00010000:2.0:1788796788.721719:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796788.721724:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5be00/0xdd273c88cfe23b9f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.721730:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5be00/0xdd273c88cfe23b9f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796788.730411:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796788.730965:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936296192 00000100:00100000:1.0:1788796788.730977:0:15986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936296192 00000100:00100000:1.0:1788796788.731043:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:1.0:1788796788.731055:0:15986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+13:14414:x1875688936296192:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796788.731082:0:15986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796788.731102:0:15986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23bb4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65edc3 expref: -99 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.731166:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23bbb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.731181:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23bbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.731193:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23bbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796788.731231:0:15986:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788796788.731235:0:15986:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796788.731252:0:15986:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23bbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.731262:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23bbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.731285:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23bb4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edc3 expref: 15 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.731325:0:15986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23bbb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edc3 expref: 14 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.731334:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:1.0:1788796788.731338:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796788.731341:0:15986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd14316b200, rc 0) 00000100:00100000:1.0:1788796788.731660:0:15986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+14:14414:x1875688936296192:12345-192.168.201.25@tcp:101:bash.0 Request processed in 606us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796788.731668:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:3.0:1788796788.735889:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796788.736000:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936296448 00000100:00100000:2.0:1788796788.736011:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936296448 00000100:00100000:2.0:1788796788.736073:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1788796788.736085:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e3c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+14:14414:x1875688936296448:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:2.0:1788796788.736444:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e3c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+15:14414:x1875688936296448:12345-192.168.201.25@tcp:35:bash.0 Request processed in 360us (565us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788796788.736695:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1788796788.847414:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796788.847596:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936296704 00000100:00100000:1.0:1788796788.847611:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936296704 00000100:00100000:1.0:1788796788.847701:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:1.0:1788796788.847713:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+15:14424:x1875688936296704:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796788.847775:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796788.847803:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23bc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65edca expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796788.847930:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788796788.848075:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23bc2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edca expref: 17 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.848090:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:1.0:1788796788.848093:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796788.848099:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23bc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edca expref: 17 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.848134:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd14316b000, rc 0) 00000100:00100000:1.0:1788796788.848213:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+16:14424:x1875688936296704:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 502us (815us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788796788.848221:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:3.0:1788796788.858016:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796788.858176:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936296960 00000100:00100000:2.0:1788796788.858188:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936296960 00000100:00100000:2.0:1788796788.858255:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:2.0:1788796788.858267:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+16:14424:x1875688936296960:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788796788.858555:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+17:14424:x1875688936296960:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 289us (550us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788796788.858564:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:2.0:1788796788.925892:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796788.926064:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936297216 00000100:00100000:0.0:1788796788.926076:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936297216 00000100:00100000:0.0:1788796788.926138:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:0.0:1788796788.926149:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+17:14427:x1875688936297216:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788796788.926174:0:16253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796788.926194:0:16253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5aa00/0xdd273c88cfe23bd0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65edd1 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.926308:0:16253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23bd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.926323:0:16253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.926335:0:16253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796788.926346:0:16253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788796788.926498:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5aa00/0xdd273c88cfe23bd0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edd1 expref: 20 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.926516:0:16253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edd1 expref: 19 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796788.926525:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:0.0:1788796788.926529:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788796788.926532:0:16253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5b800, rc 0) 00000100:00100000:0.0:1788796788.926597:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+19:14427:x1875688936297216:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 450us (717us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788796788.926604:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:3.0:1788796788.929552:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796788.929593:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796788.929688:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936297472 00000100:00100000:2.0:1788796788.929698:0:14356:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936297472 00000100:00100000:2.0:1788796788.929797:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:2.0:1788796788.929807:0:14356:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+19:2357:x1875688936297472:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796788.929832:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796788.929855:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23bd7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edd1 expref: 19 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796788.929874:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:2.0:1788796788.929880:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796788.929930:0:14356:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+18:2357:x1875688936297472:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 124us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796788.929936:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:1.0:1788796788.930108:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936297344 00000100:00100000:1.0:1788796788.930113:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936297344 00000100:00100000:1.0:1788796788.930151:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:1.0:1788796788.930159:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+18:14427:x1875688936297344:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:1.0:1788796788.930212:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23be5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.930225:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23be5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.930235:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23be5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.930259:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23be5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.930267:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23be5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.930273:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23be5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.930278:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316b000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796788.930282:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23be5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.930306:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23be5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.930315:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:1.0:1788796788.930318:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796788.930323:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23be5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796788.930328:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23be5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796788.930377:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+18:14427:x1875688936297344:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 218us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796788.930383:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:3.0:1788796788.935641:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796788.935848:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936297728 00000100:00100000:2.0:1788796788.935862:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936297728 00000100:00100000:2.0:1788796788.935942:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1788796788.935953:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+18:14427:x1875688936297728:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788796788.936258:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+19:14427:x1875688936297728:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 306us (642us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788796788.936267:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000040:00080000:1.0:1788796788.957553:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788796789.294477:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796789.294678:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936297984 00000100:00100000:2.0:1788796789.294689:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936297984 00000100:00100000:2.0:1788796789.294809:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:2.0:1788796789.294821:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+19:14458:x1875688936297984:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:2.0:1788796789.294851:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796789.294874:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23bec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65edd8 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796789.294980:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23bf3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796789.294997:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796789.295014:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796789.295027:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788796789.295202:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23bec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edd8 expref: 22 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796789.295224:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edd8 expref: 21 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796789.295252:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:2.0:1788796789.295256:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788796789.295259:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20800, rc 0) 00000100:00100000:2.0:1788796789.295321:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+21:14458:x1875688936297984:12345-192.168.201.25@tcp:101:cat.0 Request processed in 501us (866us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788796789.295329:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:3.0:1788796789.304304:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796789.305117:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936298240 00000100:00100000:2.0:1788796789.305131:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936298240 00000100:00100000:2.0:1788796789.305213:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:2.0:1788796789.305224:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+21:14458:x1875688936298240:12345-192.168.201.25@tcp:35:cat.0 00000100:00100000:2.0:1788796789.305589:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+22:14458:x1875688936298240:12345-192.168.201.25@tcp:35:cat.0 Request processed in 366us (1294us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788796789.305598:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:2.0:1788796789.305807:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796789.307269:0:16485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936298368 00000100:00100000:0.0:1788796789.307285:0:16485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936298368 00000100:00100000:0.0:1788796789.307353:0:16485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:0.0:1788796789.307365:0:16485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd2671bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+22:2357:x1875688936298368:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796789.307381:0:16485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796789.307431:0:16485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23bf3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edd8 expref: 22 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.307458:0:16485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:0.0:1788796789.307464:0:16485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796789.307535:0:16485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd2671bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+21:2357:x1875688936298368:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 172us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796789.307543:0:16485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:2.0:1788796789.411434:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796789.411564:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936298624 00000100:00100000:1.0:1788796789.411575:0:15986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936298624 00000100:00100000:1.0:1788796789.411649:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:1.0:1788796789.411661:0:15986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+21:14464:x1875688936298624:12345-192.168.201.25@tcp:101:dd.0 00010000:00010000:1.0:1788796789.411688:0:15986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796789.411724:0:15986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23c01 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eddf expref: -99 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796789.411885:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23c08 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796789.411900:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23c08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796789.411934:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23c08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796789.411948:0:15986:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788796789.412096:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23c01 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eddf expref: 24 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796789.412117:0:15986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23c08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eddf expref: 23 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796789.412127:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:1.0:1788796789.412130:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796789.412134:0:15986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd14316aa00, rc 0) 00000100:00100000:1.0:1788796789.412316:0:15986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+23:14464:x1875688936298624:12345-192.168.201.25@tcp:101:dd.0 Request processed in 658us (894us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788796789.412324:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:2.0:1788796789.424738:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796789.424928:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936298880 00000100:00100000:1.0:1788796789.424938:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936298880 00000100:00100000:1.0:1788796789.424998:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:1.0:1788796789.425008:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+23:14464:x1875688936298880:12345-192.168.201.25@tcp:36:dd.0 00010000:00010000:1.0:1788796789.425071:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788796789.425103:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23c08 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eddf expref: 23 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796789.425128:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23bbb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edc3 expref: 22 pid: 15986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796789.425159:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:1.0:1788796789.425165:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796789.425374:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23c16 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796789.425390:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23c16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796789.425401:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23c16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788796789.425482:0:14370:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788796789.425509:0:14370:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d034cdec reply state 0000000072f28cc8 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23c16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796789.425519:0:14370:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788796789.425629:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+24:14464:x1875688936298880:12345-192.168.201.25@tcp:36:dd.0 Request processed in 621us (901us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788796789.425636:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00000020:00080000:1.0:1788796789.425641:0:14370:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788796789.428352:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23c16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796789.428371:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23c16 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796789.428378:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23c16 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796789.428385:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316b000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796789.428402:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23c16 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796789.428411:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23c16 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796789.428428:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:1.0:1788796789.428431:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796789.428436:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23c16 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796789.428443:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23c16 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796789.465925:0:16484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796789.478331:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796789.478538:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936299136 00000100:00100000:3.0:1788796789.478551:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936299136 00000100:00100000:3.0:1788796789.478625:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1788796789.478636:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+23:14464:x1875688936299136:12345-192.168.201.25@tcp:35:dd.0 00000100:00100000:3.0:1788796789.478960:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+24:14464:x1875688936299136:12345-192.168.201.25@tcp:35:dd.0 Request processed in 325us (639us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1788796789.478969:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:2.0:1788796789.713942:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796789.714032:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936299264 00000100:00100000:0.0:1788796789.714042:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936299264 00000100:00100000:0.0:1788796789.714104:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:0.0:1788796789.714114:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+24:14478:x1875688936299264:12345-192.168.201.25@tcp:101:stat.0 00010000:00010000:0.0:1788796789.714139:0:16253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796789.714172:0:16253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ac00/0xdd273c88cfe23c1d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ede6 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.714243:0:16253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b400/0xdd273c88cfe23c24 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.714259:0:16253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b400/0xdd273c88cfe23c24 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.714272:0:16253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b400/0xdd273c88cfe23c24 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.714286:0:16253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ae00/0xdd273c88cfe23c2b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.714293:0:16253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ae00/0xdd273c88cfe23c2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.714317:0:16253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ae00/0xdd273c88cfe23c2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.714419:0:16253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23c32 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.714438:0:16253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23c32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.714445:0:16253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23c32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796789.714485:0:16253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788796789.714489:0:16253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788796789.714964:0:16253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23c32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.714979:0:16253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23c32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.714989:0:16253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b400/0xdd273c88cfe23c24 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.714995:0:16253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b400/0xdd273c88cfe23c24 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.715001:0:16253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b400/0xdd273c88cfe23c24 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.715008:0:16253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd141d5b400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796789.715012:0:16253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b400/0xdd273c88cfe23c24 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.715028:0:16253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b400/0xdd273c88cfe23c24 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.715043:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd25296d000) 00010000:00010000:0.0:1788796789.715046:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796789.715053:0:16253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b400/0xdd273c88cfe23c24 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.715060:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b400/0xdd273c88cfe23c24 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.715077:0:16253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ae00/0xdd273c88cfe23c2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.715084:0:16253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ae00/0xdd273c88cfe23c2b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.715089:0:16253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ae00/0xdd273c88cfe23c2b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.715094:0:16253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd141d5ae00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796789.715097:0:16253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ae00/0xdd273c88cfe23c2b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.715103:0:16253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ae00/0xdd273c88cfe23c2b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.715110:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bd25296d300) 00010000:00010000:0.0:1788796789.715113:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796789.715115:0:16253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ae00/0xdd273c88cfe23c2b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.715132:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ae00/0xdd273c88cfe23c2b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.715183:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ac00/0xdd273c88cfe23c1d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ede6 expref: 26 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.715198:0:16253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23c32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ede6 expref: 25 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796789.715206:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:0.0:1788796789.715208:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788796789.715210:0:16253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5b200, rc 0) 00000100:00100000:0.0:1788796789.715284:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+25:14478:x1875688936299264:12345-192.168.201.25@tcp:101:stat.0 Request processed in 1171us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796789.715292:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:0.0:1788796789.813906:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796789.813990:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936299520 00000100:00100000:3.0:1788796789.814000:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936299520 00000100:00100000:3.0:1788796789.814059:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:3.0:1788796789.814068:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+25:14484:x1875688936299520:12345-192.168.201.25@tcp:36:truncate.0 00010000:00010000:3.0:1788796789.814118:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796789.814152:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b200/0xdd273c88cfe23c32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ede6 expref: 25 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796789.814172:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:3.0:1788796789.814176:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788796789.814391:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23c39 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796789.814405:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23c39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796789.814414:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23c39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788796789.814475:0:14371:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1788796789.814499:0:14371:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2577171 reply state 0000000056a14698 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23c39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796789.814507:0:14371:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788796789.814619:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+27:14484:x1875688936299520:12345-192.168.201.25@tcp:36:truncate.0 Request processed in 543us (714us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788796789.814642:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 37 00000020:00080000:3.0:1788796789.814648:0:14371:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788796789.820862:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23c39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796789.820883:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23c39 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796789.820891:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23c39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796789.820898:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796789.820903:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23c39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796789.820911:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23c39 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796789.820943:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:3.0:1788796789.820946:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796789.820952:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23c39 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796789.820958:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23c39 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796790.050595:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796790.051181:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936299648 00000100:00100000:2.0:1788796790.051197:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936299648 00000100:00100000:2.0:1788796790.051284:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00080000:0.0:1788796790.051286:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796790.051300:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+26:14498:x1875688936299648:12345-192.168.201.25@tcp:101:stat.0 00010000:00010000:2.0:1788796790.051332:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796790.051355:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe23c40 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65eded expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051481:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c47 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051496:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c47 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051510:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c47 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051526:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23c4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051533:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23c4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051540:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23c4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051651:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe23c55 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051661:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe23c55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051679:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe23c55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796790.051719:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788796790.051724:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788796790.051778:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe23c55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051803:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe23c55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051811:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c47 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051818:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c47 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051825:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051831:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796790.051835:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051843:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c47 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051856:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd25296d000) 00010000:00010000:2.0:1788796790.051860:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796790.051864:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c47 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051871:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c47 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051885:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23c4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.051891:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23c4e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.052526:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23c4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.052533:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796790.052536:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23c4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.052543:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23c4e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.052552:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bd24d573d00) 00010000:00010000:2.0:1788796790.052555:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796790.052558:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23c4e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.052564:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23c4e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.052615:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe23c40 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eded expref: 28 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.052629:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe23c55 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eded expref: 27 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.052637:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:2.0:1788796790.052639:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788796790.052642:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21c00, rc 0) 00000100:00100000:2.0:1788796790.053081:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+27:14498:x1875688936299648:12345-192.168.201.25@tcp:101:stat.0 Request processed in 1784us (2494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796790.053102:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:2.0:1788796790.223929:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796790.224055:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936299904 00000100:00100000:0.0:1788796790.224129:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936299904 00000100:00100000:0.0:1788796790.224204:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:0.0:1788796790.224214:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+27:14508:x1875688936299904:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788796790.224236:0:16253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796790.224257:0:16253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ac00/0xdd273c88cfe23c5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65edf4 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788796790.224359:0:16253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788796790.224998:0:16253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ac00/0xdd273c88cfe23c5c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edf4 expref: 29 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.225017:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:0.0:1788796790.225021:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788796790.225027:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ac00/0xdd273c88cfe23c5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edf4 expref: 29 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.225045:0:16253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5ac00, rc 0) 00000100:00100000:0.0:1788796790.227425:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+28:14508:x1875688936299904:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 3200us (3495us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1788796790.227438:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:3.0:1788796790.238053:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796790.238903:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936300160 00000100:00100000:2.0:1788796790.238917:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936300160 00000100:00100000:2.0:1788796790.239054:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:2.0:1788796790.239074:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eaf1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+28:14508:x1875688936300160:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788796790.239352:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eaf1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+29:14508:x1875688936300160:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 288us (1309us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788796790.239360:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:3.0:1788796790.312384:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796790.312463:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936300416 00000100:00100000:1.0:1788796790.312478:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936300416 00000100:00100000:1.0:1788796790.312773:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:1.0:1788796790.312788:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+29:14514:x1875688936300416:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788796790.312830:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796790.312852:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23c6a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65edfb expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.312954:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.312969:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5bc00/0xdd273c88cfe23ba6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edbc expref: 30 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.312978:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe23c55 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eded expref: 30 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.313005:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.313043:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe23c55 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eded expref: 30 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.313060:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe23c55 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eded expref: 30 pid: 14369 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796790.313188:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267306680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875688959355264:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796790.313560:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5bc00/0xdd273c88cfe23ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edbc expref: 30 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.313571:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5bc00/0xdd273c88cfe23ba6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edbc expref: 30 pid: 16253 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796790.313582:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267304a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875688959355392:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788796790.313636:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd245cfd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788796790.318372:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796790.318982:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936300544 00000100:00100000:2.0:1788796790.318994:0:14356:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936300544 00010000:00010000:2.0:1788796790.319048:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe23c55 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eded expref: 31 pid: 14369 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796790.319106:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:2.0:1788796790.319120:0:14356:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267278050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+31:2358:x1875688936300544:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796790.319139:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796790.319147:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe23c55 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eded expref: 31 pid: 14369 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.319161:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe23c55 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eded expref: 31 pid: 14369 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.319186:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:2.0:1788796790.319192:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.319215:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.319223:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796790.319288:0:14356:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267278050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+31:2358:x1875688936300544:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 171us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796790.319296:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00010000:00010000:1.0:1788796790.320301:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21c00/0xdd273c88cfe23c55 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65eded expref: 30 pid: 14369 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796790.320326:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267306680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875688959355264:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788796790.322021:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267304a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875688959355392:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796790.322055:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796790.329816:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796790.338165:0:16485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936300672 00000100:00100000:0.0:1788796790.338185:0:16485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936300672 00010000:00010000:0.0:1788796790.338241:0:16485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5bc00/0xdd273c88cfe23ba6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edbc expref: 30 pid: 16253 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796790.338294:0:16485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:0.0:1788796790.338305:0:16485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+30:2358:x1875688936300672:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796790.338323:0:16485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796790.338331:0:16485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5bc00/0xdd273c88cfe23ba6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edbc expref: 30 pid: 16253 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.338346:0:16485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5bc00/0xdd273c88cfe23ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edbc expref: 30 pid: 16253 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.338380:0:16485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5bc00/0xdd273c88cfe23ba6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edbc expref: 30 pid: 16253 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.338421:0:16485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:0.0:1788796790.338427:0:16485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.338436:0:16485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.338813:0:16485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.338886:0:16485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796790.338976:0:16485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+29:2358:x1875688936300672:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 671us (9171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796790.338985:0:16485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00010000:00010000:2.0:1788796790.341499:0:14370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.341519:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796790.341546:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1788796790.341890:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b000/0xdd273c88cfe23c6a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edfb expref: 30 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.341928:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edfb expref: 29 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.341938:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:2.0:1788796790.341941:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788796790.341945:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd14316b200, rc 0) 00000100:00100000:2.0:1788796790.342147:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+29:14514:x1875688936300416:12345-192.168.201.25@tcp:101:bash.0 Request processed in 29362us (29784us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1788796790.342156:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:3.0:1788796790.344387:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796790.344614:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936300928 00000100:00100000:2.0:1788796790.344626:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936300928 00000100:00100000:2.0:1788796790.344705:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:2.0:1788796790.344717:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+29:14514:x1875688936300928:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:2.0:1788796790.345082:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe23c7f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.345102:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe23c7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.345606:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe23c7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788796790.345680:0:14369:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788796790.345707:0:14369:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004127b476 reply state 000000000a699b98 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe23c7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796790.345716:0:14369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788796790.345861:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+32:14514:x1875688936300928:12345-192.168.201.25@tcp:36:bash.0 Request processed in 1143us (1494us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788796790.345871:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 41 00000020:00080000:2.0:1788796790.345878:0:14369:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788796790.348404:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:1.0:1788796790.348621:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe23c7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.348634:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe23c7f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.348642:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe23c7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.348648:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21a00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796790.348653:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe23c7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.348662:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe23c7f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.348679:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:1.0:1788796790.348683:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796790.348687:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe23c7f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.348693:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21a00/0xdd273c88cfe23c7f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796790.348787:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936301056 00000100:00100000:0.0:1788796790.348800:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936301056 00000100:00100000:0.0:1788796790.348869:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:0.0:1788796790.348880:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+31:14514:x1875688936301056:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1788796790.348904:0:16253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796790.348933:0:16253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5bc00/0xdd273c88cfe23c86 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ee02 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.349384:0:16253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5bc00/0xdd273c88cfe23c86 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee02 expref: 32 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.349401:0:16253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5bc00/0xdd273c88cfe23c86 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee02 expref: 32 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.349449:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:0.0:1788796790.349453:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788796790.349456:0:16253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5bc00, rc 0) 00000100:00100000:0.0:1788796790.349521:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+32:14514:x1875688936301056:12345-192.168.201.25@tcp:101:bash.0 Request processed in 642us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796790.349528:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:0.0:1788796790.363672:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796790.363939:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936301184 00000100:00100000:2.0:1788796790.363957:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936301184 00000100:00100000:2.0:1788796790.364028:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:2.0:1788796790.364040:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+32:14514:x1875688936301184:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1788796790.364061:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796790.364084:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23c8d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ee09 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.364167:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.364206:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edfb expref: 33 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.364215:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c94 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.364249:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edfb expref: 33 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.364262:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edfb expref: 33 pid: 14370 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796790.364275:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875688959355520:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796790.364350:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247daa180 going to sleep for 11 seconds 00000100:00100000:2.0:1788796790.369821:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875688959355520:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796790.369857:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796790.373702:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796790.373994:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936301312 00000100:00100000:2.0:1788796790.374005:0:14356:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936301312 00010000:00010000:2.0:1788796790.374053:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edfb expref: 34 pid: 14370 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796790.374097:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:2.0:1788796790.374108:0:14356:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+34:2358:x1875688936301312:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796790.374124:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796790.374144:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edfb expref: 34 pid: 14370 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.374158:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edfb expref: 34 pid: 14370 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.374180:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23c71 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65edfb expref: 34 pid: 14370 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.374197:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:2.0:1788796790.374202:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.374211:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.374219:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c94 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796790.374259:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796790.374315:0:14356:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e846a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+33:2358:x1875688936301312:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 209us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796790.374323:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00010000:00010000:1.0:1788796790.375319:0:14370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.375331:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796790.375385:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788796790.375399:0:14370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796790.375422:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.375460:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21200/0xdd273c88cfe23c8d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee09 expref: 33 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.375477:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee09 expref: 32 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796790.375485:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:1.0:1788796790.375488:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788796790.375491:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d21400, rc 0) 00000100:00100000:1.0:1788796790.375548:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+32:14514:x1875688936301184:12345-192.168.201.25@tcp:101:bash.0 Request processed in 11510us (11888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796790.375556:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:0.0:1788796790.389833:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796790.390019:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936301568 00000100:00100000:3.0:1788796790.390031:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936301568 00000100:00100000:3.0:1788796790.390107:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:3.0:1788796790.390119:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+32:14514:x1875688936301568:12345-192.168.201.25@tcp:103:bash.0 00010000:00010000:3.0:1788796790.390139:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788796790.390167:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23c94 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee09 expref: 32 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796790.390193:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5bc00/0xdd273c88cfe23c86 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee02 expref: 31 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796790.390205:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd25296da00) 00010000:00010000:3.0:1788796790.390218:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796790.390286:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+30:14514:x1875688936301568:12345-192.168.201.25@tcp:103:bash.0 Request processed in 168us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796790.390293:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:0.0:1788796790.394926:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796790.395786:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936301696 00000100:00100000:3.0:1788796790.395954:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936301696 00000100:00100000:3.0:1788796790.396028:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:3.0:1788796790.396040:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+30:14514:x1875688936301696:12345-192.168.201.25@tcp:58:bash.0 00010000:00010000:3.0:1788796790.396162:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030800/0xdd273c88cfe23c9b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796790.396183:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030800/0xdd273c88cfe23c9b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796790.396198:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030800/0xdd273c88cfe23c9b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788796790.398203:0:14371:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788796790.398362:0:14371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788796790.398570:0:14371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788796790.399029:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+30:14514:x1875688936301696:12345-192.168.201.25@tcp:58:bash.0 Request processed in 2985us (4111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796790.399043:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:1.0:1788796790.401732:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796790.401940:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936301824 00000100:00100000:0.0:1788796790.401950:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936301824 00000100:00100000:0.0:1788796790.402096:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:0.0:1788796790.402109:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+30:14514:x1875688936301824:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1788796790.402136:0:16253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796790.402156:0:16253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5aa00/0xdd273c88cfe23ca2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ee10 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.402214:0:16253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030800/0xdd273c88cfe23c9b lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.402226:0:16253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5aa00/0xdd273c88cfe23ca2 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee10 expref: 31 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.402245:0:16253:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030800/0xdd273c88cfe23c9b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.402278:0:16253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5aa00/0xdd273c88cfe23ca2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee10 expref: 31 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.402293:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd24712b000) 00010000:00010000:0.0:1788796790.402297:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788796790.402301:0:16253:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5aa00/0xdd273c88cfe23ca2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee10 expref: 31 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796790.402309:0:16253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5aa00, rc 0) 00000100:00100000:0.0:1788796790.402386:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+31:14514:x1875688936301824:12345-192.168.201.25@tcp:101:bash.0 Request processed in 279us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796790.402393:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00010000:00010000:2.0:1788796790.490493:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788796791.004252:0:14403:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788796791.004267:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788796791.004307:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788796791.004315:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788796791.004451:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267306680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14403:1875688959355648:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788796791.004731:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd245cfdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788796791.010437:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267306680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14403:1875688959355648:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788796791.015976:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796791.017377:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936301952 00000100:00100000:0.0:1788796791.017392:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936301952 00000100:00100000:0.0:1788796791.017481:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:0.0:1788796791.017493:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+31:14515:x1875688936301952:12345-192.168.201.25@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788796791.024643:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+31:14515:x1875688936301952:12345-192.168.201.25@tcp:900:lhsmtool_posix.0 Request processed in 7136us (8663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796791.024661:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:1.0:1788796791.034879:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796791.035598:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936302080 00000100:00100000:2.0:1788796791.035611:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936302080 00000100:00100000:2.0:1788796791.035684:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:2.0:1788796791.035697:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+31:14515:x1875688936302080:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788796791.035731:0:14370:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788796791.035896:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+31:14515:x1875688936302080:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 202us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796791.035904:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:3.0:1788796791.039173:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.039283:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936302208 00000100:00100000:1.0:1788796791.039293:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936302208 00000100:00100000:1.0:1788796791.039351:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:1.0:1788796791.039377:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+31:14515:x1875688936302208:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788796791.039474:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23ca9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039491:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039506:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039558:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23cb0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039567:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039574:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039606:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23cb7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039614:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039620:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796791.039658:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788796791.039662:0:14371:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796791.039678:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039690:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039703:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23ca9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039710:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23ca9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039715:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316a000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796791.039720:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23ca9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039727:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23ca9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039740:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd24d573f00) 00010000:00010000:1.0:1788796791.039743:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796791.039797:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23ca9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039804:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23ca9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039819:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039826:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23cb0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039832:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039837:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316aa00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796791.039846:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039853:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23cb0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039861:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9bd24943d100) 00010000:00010000:1.0:1788796791.039863:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796791.039866:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23cb0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039872:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23cb0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039886:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039892:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23cb7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039898:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039903:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316b200 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796791.039906:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039912:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23cb7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039919:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd24712b000) 00010000:00010000:1.0:1788796791.039921:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796791.039930:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23cb7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.039936:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b200/0xdd273c88cfe23cb7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796791.040026:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+31:14515:x1875688936302208:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 Request processed in 657us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796791.040035:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:0.0:1788796791.044545:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796791.044664:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936302464 00000100:00100000:2.0:1788796791.044677:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936302464 00000100:00100000:2.0:1788796791.044780:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:2.0:1788796791.044798:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+31:14515:x1875688936302464:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788796791.044824:0:16253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796791.044846:0:16253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe23cbe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ee17 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.044963:0:16253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23cc5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.044983:0:16253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.044997:0:16253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788796791.045009:0:16253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788796791.045125:0:16253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.045134:0:16253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23cc5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.045142:0:16253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.045148:0:16253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796791.045162:0:16253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.045169:0:16253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23cc5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.045181:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd24712b000) 00010000:00010000:2.0:1788796791.045184:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788796791.045189:0:16253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23cc5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.045195:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23cc5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.045236:0:16253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe23cbe lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee17 expref: 33 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.045246:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bd24d573f00) 00010000:00010000:2.0:1788796791.045248:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788796791.045252:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe23cbe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee17 expref: 33 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.045260:0:16253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20a00, rc 0) 00000100:00100000:2.0:1788796791.045328:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+32:14515:x1875688936302464:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 533us (795us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1788796791.045336:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:2.0:1788796791.048892:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.049165:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936302592 00000100:00100000:1.0:1788796791.049176:0:15986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936302592 00000100:00100000:1.0:1788796791.049265:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:1.0:1788796791.049276:0:15986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+32:14515:x1875688936302592:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788796791.049311:0:15986:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788796791.049814:0:15986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+32:14515:x1875688936302592:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 536us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796791.049822:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:3.0:1788796791.075388:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796791.075729:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936302848 00000100:00100000:2.0:1788796791.075782:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936302848 00000100:00100000:2.0:1788796791.075848:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:2.0:1788796791.075874:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+32:14515:x1875688936302848:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788796791.075897:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796791.075918:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe23cd3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ee1e expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788796791.076945:0:14369:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1788796791.076955:0:14369:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788796791.077010:0:14369:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788796791.077854:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23cda lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.077875:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23cda lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.077890:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23cda lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.077964:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20a00/0xdd273c88cfe23cd3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee1e expref: 35 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.077987:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23cda lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee1e expref: 34 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.077997:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd24d573d00) 00010000:00010000:2.0:1788796791.078000:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788796791.078003:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd247d20600, rc 0) 00000100:00100000:2.0:1788796791.078143:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+34:14515:x1875688936302848:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 2271us (2767us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788796791.078154:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:0.0:1788796791.095515:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.095977:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936303104 00000100:00100000:1.0:1788796791.095990:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936303104 00000100:00100000:1.0:1788796791.096059:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:1.0:1788796791.096070:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+34:14515:x1875688936303104:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788796791.096136:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788796791.096169:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20600/0xdd273c88cfe23cda lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee1e expref: 34 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.096192:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd24d573d00) 00010000:00010000:1.0:1788796791.096206:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788796791.096232:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23ce8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.096277:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23ce8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.096289:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23ce8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.096307:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23cef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x92377504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.096315:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23cef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92377504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.096322:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23cef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92377504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.096966:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23ce8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.096977:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23ce8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.096985:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23ce8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.096991:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316aa00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796791.096995:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23ce8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.097003:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23ce8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.097013:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd25296d000) 00010000:00010000:1.0:1788796791.097026:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796791.097031:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23ce8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.097037:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23ce8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.097050:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23cef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92377504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.097055:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23cef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92377504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.097060:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23cef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92377504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.097065:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316a000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:1.0:1788796791.097068:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23cef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92377504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.097074:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23cef lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92377504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.097080:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x92377504 (ffff9bd24943d100) 00010000:00010000:1.0:1788796791.097083:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788796791.097085:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23cef lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x92377504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.097090:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a000/0xdd273c88cfe23cef lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x92377504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788796791.097444:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+33:14515:x1875688936303104:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 1372us (1937us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788796791.097460:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:1.0:1788796791.100784:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796791.100865:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936303232 00000100:00100000:3.0:1788796791.100877:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936303232 00000100:00100000:3.0:1788796791.100937:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:3.0:1788796791.100947:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+33:14515:x1875688936303232:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788796791.100972:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796791.100994:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23cf6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ee25 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.101030:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030c00/0xdd273c88cfe23cfd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.101042:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030c00/0xdd273c88cfe23cfd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.101055:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030c00/0xdd273c88cfe23cfd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.101168:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23cf6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee25 expref: 35 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.101194:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030c00/0xdd273c88cfe23cfd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee25 expref: 34 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.101203:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd24712b200) 00010000:00010000:3.0:1788796791.101206:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788796791.101209:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240030c00, rc 0) 00000100:00100000:3.0:1788796791.101279:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+34:14515:x1875688936303232:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 332us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796791.101285:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:3.0:1788796791.114717:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796791.115161:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936303488 00000100:00100000:0.0:1788796791.115173:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936303488 00000100:00100000:0.0:1788796791.115249:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:0.0:1788796791.115259:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+34:14515:x1875688936303488:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788796791.115540:0:16253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ba00/0xdd273c88cfe23d04 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.115560:0:16253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ba00/0xdd273c88cfe23d04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.115574:0:16253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ba00/0xdd273c88cfe23d04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788796791.116050:0:16253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788796791.116061:0:16253:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 518097314607ns, next at 519097311969ns, rc = 0 00000004:00010000:0.0:1788796791.116151:0:16253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002dcdc5a1 reply state 0000000002d2995d transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ba00/0xdd273c88cfe23d04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796791.116159:0:16253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788796791.116543:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+36:14515:x1875688936303488:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 1282us (1835us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1788796791.116553:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 53 00010000:00010000:3.0:1788796791.120377:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ba00/0xdd273c88cfe23d04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.120411:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ba00/0xdd273c88cfe23d04 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.120420:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ba00/0xdd273c88cfe23d04 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.120426:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd141d5ba00 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796791.120431:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ba00/0xdd273c88cfe23d04 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.120438:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ba00/0xdd273c88cfe23d04 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.120459:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd24712b200) 00010000:00010000:3.0:1788796791.120462:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788796791.120484:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ba00/0xdd273c88cfe23d04 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.120490:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5ba00/0xdd273c88cfe23d04 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796791.129079:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.129934:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936303616 00000100:00100000:1.0:1788796791.129946:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936303616 00000100:00100000:1.0:1788796791.130017:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:1.0:1788796791.130028:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+35:14515:x1875688936303616:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788796791.130062:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788796791.130242:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23d0b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ee2c expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.130319:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23d0b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee2c expref: 36 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.130337:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23d0b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee2c expref: 36 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.130358:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd24712b200) 00010000:00010000:2.0:1788796791.130361:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788796791.130366:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd14316aa00, rc 0) 00000100:00100000:2.0:1788796791.130445:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+36:14515:x1875688936303616:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 417us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796791.130452:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:0.0:1788796791.135106:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.135288:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936303744 00000100:00100000:1.0:1788796791.135299:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936303744 00000100:00100000:1.0:1788796791.135418:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:1.0:1788796791.135441:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+5:2357:x1875688936303744:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788796791.135899:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:2357:x1875688936303744:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 470us (805us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788796791.135908:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:1.0:1788796791.139397:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796791.139915:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936304000 00000100:00100000:2.0:1788796791.139926:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936304000 00000100:00100000:2.0:1788796791.139994:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:2.0:1788796791.140005:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+36:14515:x1875688936304000:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788796791.140288:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+37:14515:x1875688936304000:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 284us (902us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788796791.140297:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00080000:0.0:1788796791.147096:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788796791.152122:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796791.153096:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936304256 00000100:00100000:3.0:1788796791.153111:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936304256 00000100:00100000:2.0:1788796791.153608:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:2.0:1788796791.153621:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+37:14515:x1875688936304256:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788796791.153741:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+37:14515:x1875688936304256:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 122us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796791.156025:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:0.0:1788796791.157193:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.157407:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936304384 00000100:00100000:1.0:1788796791.157420:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936304384 00000100:00100000:1.0:1788796791.157498:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:1.0:1788796791.157508:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+37:14515:x1875688936304384:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788796791.157539:0:16253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796791.157570:0:16253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23d12 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ee33 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.157669:0:16253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23d19 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.157706:0:16253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23d19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.157719:0:16253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23d19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796791.157806:0:16253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788796791.157828:0:16253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23d19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.157855:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23d12 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee33 expref: 39 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.157874:0:16253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23d19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee33 expref: 38 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.157883:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd24712b200) 00010000:00010000:1.0:1788796791.157886:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788796791.157889:0:16253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd14316b400, rc 0) 00000100:00100000:1.0:1788796791.157962:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+38:14515:x1875688936304384:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 455us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796791.157968:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:3.0:1788796791.161513:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.162012:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936304512 00000100:00100000:1.0:1788796791.162024:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936304512 00000100:00100000:1.0:1788796791.166490:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:1.0:1788796791.166533:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:2356:x1875688936304512:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788796791.166561:0:15054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796791.166611:0:15054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b86a0aa1/0xdd273c88cfe23d20 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ee3a expref: -99 pid: 15054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788796791.166642:0:15054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9edf77, blocks: 0x1 00010000:00010000:1.0:1788796791.166665:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788796791.166670:0:15054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788796791.166680:0:15054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b86a0aa1/0xdd273c88cfe23d20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee3a expref: 7 pid: 15054 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.166702:0:15054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b86a0aa1/0xdd273c88cfe23d20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee3a expref: 7 pid: 15054 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.166715:0:15054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd14316ac00, rc 0) 00000100:00100000:1.0:1788796791.166962:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+7:2356:x1875688936304512:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 456us (5458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796791.166969:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:3.0:1788796791.177345:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796791.177548:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936304768 00000100:00100000:2.0:1788796791.177562:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936304768 00000100:00100000:2.0:1788796791.177637:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:2.0:1788796791.177649:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+38:14515:x1875688936304768:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788796791.177834:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+38:14515:x1875688936304768:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 187us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796791.177842:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:0.0:1788796791.182799:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.183054:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936304896 00000100:00100000:1.0:1788796791.183065:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936304896 00000100:00100000:1.0:1788796791.183123:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:1.0:1788796791.183132:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+38:14515:x1875688936304896:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788796791.271037:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:0.0:1788796791.271053:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788796791.271077:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:0.0:1788796791.271096:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1788796791.271101:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000001:00080000:0.0:1788796791.271151:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1788796791.271389:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788796791.271418:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd247d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959355776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788796791.271692:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796791.271877:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959355776 00000100:00100000:0.0:1788796791.271886:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959355776 00000100:00100000:0.0:1788796791.271944:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788796791.271956:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875688959355776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788796791.272137:0:15052:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788796791.272141:0:15052:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788796791.272143:0:15052:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788796791.272145:0:15052:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788796791 -> 1788796791 00002000:00010000:0.0:1788796791.272147:0:15052:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788796791.272191:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875688959355776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 237us (498us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788796791.272199:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788796791.272225:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788796791.272302:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bd247d65f80/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788796791.272311:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd247d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875688959355776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788796791.272633:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+13:14515:x1875688936304896:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 Request processed in 89498us (89888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796791.272642:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:3.0:1788796791.276131:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796791.276281:0:15985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936305024 00000100:00100000:2.0:1788796791.276293:0:15985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936305024 00000100:00100000:2.0:1788796791.276361:0:15985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:2.0:1788796791.276372:0:15985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+7:2358:x1875688936305024:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788796791.276505:0:15985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+7:2358:x1875688936305024:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 Request processed in 133us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796791.276644:0:15985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:3.0:1788796791.287411:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796791.287553:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936305280 00000100:00100000:2.0:1788796791.287564:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936305280 00000100:00100000:2.0:1788796791.287643:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:2.0:1788796791.287654:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+13:14515:x1875688936305280:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788796791.287711:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796791.287739:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23d19 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee33 expref: 13 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.287797:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd24712b200) 00010000:00010000:2.0:1788796791.287803:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788796791.287932:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d27 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.287947:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.287958:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788796791.288163:0:14369:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000855ba757 reply state 00000000cb70ecbd transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796791.288173:0:14369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788796791.288289:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+14:14515:x1875688936305280:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 636us (887us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788796791.288296:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 59 00010000:00010000:2.0:1788796791.297165:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.297195:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d27 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.297204:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d27 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.297211:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:2.0:1788796791.297215:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d27 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.297223:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d27 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.297239:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd24712b200) 00010000:00010000:2.0:1788796791.297242:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788796791.297247:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d27 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.297253:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d27 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796791.308741:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796791.309040:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936305408 00000100:00100000:0.0:1788796791.309052:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936305408 00000100:00100000:0.0:1788796791.309114:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:0.0:1788796791.309126:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+7:14515:x1875688936305408:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788796791.309149:0:15052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788796791.309170:0:15052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb4a7479/0xdd273c88cfe23d2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ee41 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.309226:0:15052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b86a0aa1/0xdd273c88cfe23d20 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee3a expref: 8 pid: 15054 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.309236:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796791.309241:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796791.309246:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb4a7479/0xdd273c88cfe23d2e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee41 expref: 8 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.309292:0:15052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b86a0aa1/0xdd273c88cfe23d20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee3a expref: 8 pid: 15054 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.309307:0:15052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b86a0aa1/0xdd273c88cfe23d20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee3a expref: 8 pid: 15054 timeout: 618 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796791.309322:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e847800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15052:1875688959355904:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788796791.309439:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26737ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788796791.317381:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e847800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15052:1875688959355904:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788796791.317418:0:15052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bb4a7479/0xdd273c88cfe23d2e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee41 expref: 8 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.317462:0:15052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd141d5a800, rc 0) 00000100:00100000:1.0:1788796791.317534:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+8:14515:x1875688936305408:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 8411us (8804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796791.317543:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788796791.320230:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796791.320414:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936305536 00000100:00100000:2.0:1788796791.320425:0:14356:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936305536 00010000:00010000:2.0:1788796791.320479:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b86a0aa1/0xdd273c88cfe23d20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee3a expref: 8 pid: 15054 timeout: 618 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796791.320529:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:2.0:1788796791.320540:0:14356:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267304700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+8:2357:x1875688936305536:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788796791.320573:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788796791.320606:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b86a0aa1/0xdd273c88cfe23d20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee3a expref: 8 pid: 15054 timeout: 618 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.320620:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b86a0aa1/0xdd273c88cfe23d20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee3a expref: 8 pid: 15054 timeout: 618 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.320644:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b86a0aa1/0xdd273c88cfe23d20 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee3a expref: 8 pid: 15054 timeout: 618 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.320666:0:14356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796791.320671:0:14356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788796791.320679:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb4a7479/0xdd273c88cfe23d2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee41 expref: 7 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.320688:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb4a7479/0xdd273c88cfe23d2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee41 expref: 7 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.320728:0:14356:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bb4a7479/0xdd273c88cfe23d2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee41 expref: 7 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796791.320743:0:14356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14356:1875688959356032:192.168.201.25@tcp:105: 00000100:00100000:2.0:1788796791.320878:0:14356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247daae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788796791.326609:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796791.326638:0:14356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14356:1875688959356032:192.168.201.25@tcp:105: 00010000:00010000:2.0:1788796791.326664:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788796791.326785:0:14356:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267304700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+7:2357:x1875688936305536:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 6205us (6525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796791.326797:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:0.0:1788796791.326885:0:15985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936305664 00000100:00100000:0.0:1788796791.326894:0:15985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936305664 00000100:00100000:0.0:1788796791.326949:0:15985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:0.0:1788796791.326960:0:15985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd247d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+7:2357:x1875688936305664:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788796791.327178:0:15985:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788796791.327182:0:15985:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788796791 00002000:00010000:0.0:1788796791.327185:0:15985:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788796789 00002000:00010000:0.0:1788796791.327187:0:15985:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788796791 -> 1788796791 00002000:00010000:0.0:1788796791.327190:0:15985:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788796791.327241:0:15985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd247d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+8:2357:x1875688936305664:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 274us (634us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788796791.327249:0:15985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:3.0:1788796791.332679:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796791.335896:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936305792 00000100:00100000:0.0:1788796791.335915:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936305792 00000100:00100000:0.0:1788796791.335997:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:0.0:1788796791.336009:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+8:2357:x1875688936305792:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788796791.336072:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e10937e8/0xdd273c88cfe23d35 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.336088:0:15055:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb4a7479/0xdd273c88cfe23d2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee41 expref: 8 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.336094:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788796791.336097:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788796791.336100:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10937e8/0xdd273c88cfe23d35 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.336129:0:15055:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb4a7479/0xdd273c88cfe23d2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee41 expref: 8 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.336140:0:15055:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb4a7479/0xdd273c88cfe23d2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee41 expref: 8 pid: 15052 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796791.336151:0:15055:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15055:1875688959356160:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788796791.336224:0:15055:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26737e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788796791.342134:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796791.342389:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936305920 00000100:00100000:3.0:1788796791.342397:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936305920 00000100:00100000:0.0:1788796791.342397:0:15055:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e844380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15055:1875688959356160:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788796791.342424:0:15055:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e10937e8/0xdd273c88cfe23d35 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.342444:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb4a7479/0xdd273c88cfe23d2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee41 expref: 9 pid: 15052 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796791.342480:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:3.0:1788796791.342489:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+9:2357:x1875688936305920:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788796791.342503:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788796791.342537:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb4a7479/0xdd273c88cfe23d2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee41 expref: 9 pid: 15052 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.342551:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb4a7479/0xdd273c88cfe23d2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee41 expref: 9 pid: 15052 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.342576:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb4a7479/0xdd273c88cfe23d2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee41 expref: 9 pid: 15052 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.342602:0:14354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788796791.342607:0:14354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788796791.342613:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e10937e8/0xdd273c88cfe23d35 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.342642:0:14354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10937e8/0xdd273c88cfe23d35 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.342677:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788796791.342801:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+8:2357:x1875688936305920:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 255us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796791.342810:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00010000:00010000:0.0:1788796791.343329:0:15055:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e10937e8/0xdd273c88cfe23d35 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.343365:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e10937e8/0xdd273c88cfe23d35 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.343392:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e10937e8/0xdd273c88cfe23d35 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.343400:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e10937e8/0xdd273c88cfe23d35 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.343407:0:15055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e10937e8/0xdd273c88cfe23d35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.343414:0:15055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd141d5b800 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:0.0:1788796791.343418:0:15055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e10937e8/0xdd273c88cfe23d35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.343427:0:15055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e10937e8/0xdd273c88cfe23d35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.343441:0:15055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e10937e8/0xdd273c88cfe23d35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.343448:0:15055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e10937e8/0xdd273c88cfe23d35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796791.343526:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+7:2357:x1875688936305792:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 Request processed in 7519us (10858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796791.343534:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:1.0:1788796791.353048:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796791.353346:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936306176 00000100:00100000:2.0:1788796791.353368:0:15986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936306176 00000100:00100000:2.0:1788796791.353461:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:2.0:1788796791.353472:0:15986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+13:14515:x1875688936306176:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788796791.353566:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23d3c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.353594:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23d3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.353605:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23d3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.353871:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23d43 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.353883:0:15986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23d0b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee2c expref: 14 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.353892:0:15986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23d43 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.353927:0:15986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23d0b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee2c expref: 14 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.353943:0:15986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23d0b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee2c expref: 14 pid: 14370 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796791.353970:0:15986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15986:1875688959356288:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788796791.354055:0:15986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247daa600 going to sleep for 11 seconds 00000100:00100000:3.0:1788796791.362944:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796791.363443:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936306304 00000100:00100000:0.0:1788796791.363456:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936306304 00010000:00010000:0.0:1788796791.363501:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23d0b lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee2c expref: 15 pid: 14370 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796791.363535:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:0.0:1788796791.363545:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+15:2357:x1875688936306304:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788796791.363560:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788796791.363567:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23d0b lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee2c expref: 15 pid: 14370 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.363590:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23d0b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee2c expref: 15 pid: 14370 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.363616:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd24712b200) 00010000:00010000:0.0:1788796791.363621:0:14355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23d43 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.363630:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23d43 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.363637:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23d43 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.363672:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788796791.363727:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+15:2357:x1875688936306304:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 183us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796791.363734:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00010000:00010000:2.0:1788796791.363914:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316aa00/0xdd273c88cfe23d0b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee2c expref: 14 pid: 14370 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796791.363929:0:15986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15986:1875688959356288:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788796791.363949:0:15986:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23d43 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.363958:0:15986:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23d43 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788796791.363964:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23d43 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788796791.364152:0:15986:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788796791.364310:0:15986:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788796791.364351:0:15986:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1788796791.364440:0:15986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15986:1875688959356416:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788796791.364534:0:15986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796791.364570:0:15986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd247daaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788796791.364806:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959356416 00000100:00100000:0.0:1788796791.364813:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959356416 00000100:00100000:0.0:1788796791.364841:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788796791.364849:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15986:x1875688959356416:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788796791.364935:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15986:x1875688959356416:12345-0@lo:1000:mdt00_003.0 Request processed in 87us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796791.364941:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788796791.364978:0:15986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15986:1875688959356416:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788796791.365638:0:15986:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1788796791.365708:0:15986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27e844380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15986:1875688959356544:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788796791.365782:0:15986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788796791.365804:0:15986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26737e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788796791.365823:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959356544 00000100:00100000:0.0:1788796791.365827:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959356544 00000100:00100000:0.0:1788796791.365850:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796791.365857:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15986:x1875688959356544:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788796791.366024:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15986:x1875688959356544:12345-0@lo:1000:mdt00_003.0 Request processed in 167us (242us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788796791.366032:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788796791.366067:0:15986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27e844380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15986:1875688959356544:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788796791.366096:0:15986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23d43 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.366113:0:15986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23d43 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.366121:0:15986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23d43 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.366127:0:15986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d21400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796791.366131:0:15986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23d43 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.366139:0:15986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23d43 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.366154:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd24712b200) 00010000:00010000:0.0:1788796791.366157:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788796791.366161:0:15986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23d43 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.366167:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d21400/0xdd273c88cfe23d43 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.366198:0:15986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030800/0xdd273c88cfe23c9b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.366204:0:15986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030800/0xdd273c88cfe23c9b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.366211:0:15986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030800/0xdd273c88cfe23c9b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.366215:0:15986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240030800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796791.366224:0:15986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030800/0xdd273c88cfe23c9b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.366230:0:15986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030800/0xdd273c88cfe23c9b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.366238:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd24712b000) 00010000:00010000:0.0:1788796791.366240:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788796791.366247:0:15986:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5aa00/0xdd273c88cfe23ca2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee10 expref: 17 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.366257:0:15986:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5aa00/0xdd273c88cfe23ca2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee10 expref: 17 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.366266:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5aa00/0xdd273c88cfe23ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee10 expref: 17 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.366290:0:15986:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5aa00/0xdd273c88cfe23ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee10 expref: 17 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788796791.366302:0:15986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267999c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15986:1875688959356672:192.168.201.25@tcp:105: 00000100:00100000:0.0:1788796791.366379:0:15986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9bd26737e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788796791.387838:0:15986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267999c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15986:1875688959356672:192.168.201.25@tcp:105: 00010000:00010000:0.0:1788796791.387871:0:15986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030800/0xdd273c88cfe23c9b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.387882:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030800/0xdd273c88cfe23c9b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.387934:0:15986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23d4a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.387949:0:15986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23d4a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.387962:0:15986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23d4a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.387974:0:15986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23d4a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.387980:0:15986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23d4a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.387987:0:15986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23d4a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.387993:0:15986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd141d5b800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796791.387998:0:15986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23d4a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.388005:0:15986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23d4a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.388016:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd24712b000) 00010000:00010000:0.0:1788796791.388019:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788796791.388023:0:15986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23d4a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.388029:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd141d5b800/0xdd273c88cfe23d4a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.388045:0:15986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23d3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.388051:0:15986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23d3c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.388057:0:15986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23d3c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.388063:0:15986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd247d20800 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:0.0:1788796791.388065:0:15986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23d3c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.388072:0:15986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23d3c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.388079:0:15986:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd24712b000) 00010000:00010000:0.0:1788796791.388082:0:15986:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788796791.388085:0:15986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23d3c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788796791.388090:0:15986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd247d20800/0xdd273c88cfe23d3c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15986 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788796791.388825:0:15986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+17:14515:x1875688936306176:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 35349us (35782us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1788796791.388836:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00000020:00080000:2.0:1788796791.388842:0:15986:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788796791.389015:0:14403:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788796791.389020:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788796791.389046:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788796791.389051:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788796791.390680:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796791.390774:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936306432 00000100:00100000:2.0:1788796791.390785:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936306432 00000100:00100000:2.0:1788796791.390902:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:2.0:1788796791.390914:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+17:14514:x1875688936306432:12345-192.168.201.25@tcp:49:bash.0 00000100:00100000:2.0:1788796791.391073:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+17:14514:x1875688936306432:12345-192.168.201.25@tcp:49:bash.0 Request processed in 161us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796791.391081:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:0.0:1788796791.396398:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796791.410130:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796791.410370:0:15985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936306816 00000100:00100000:3.0:1788796791.410381:0:15985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936306816 00000100:00100000:3.0:1788796791.410823:0:15985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:3.0:1788796791.410836:0:15985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+7:14514:x1875688936306816:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788796791.410857:0:15985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788796791.410879:0:15985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaab94c3/0xdd273c88cfe23d51 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ee48 expref: -99 pid: 15985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788796791.410919:0:15985:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9edf77, atime: 0x6a9edf75, ctime: 0x6a9edf77, blocks: 0x1 00010000:00010000:3.0:1788796791.410942:0:15985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788796791.410946:0:15985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788796791.410956:0:15985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaab94c3/0xdd273c88cfe23d51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee48 expref: 8 pid: 15985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.410992:0:15985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aaab94c3/0xdd273c88cfe23d51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee48 expref: 8 pid: 15985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.411006:0:15985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd240031400, rc 0) 00000100:00100000:3.0:1788796791.411066:0:15985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+8:14514:x1875688936306816:12345-192.168.201.25@tcp:101:bash.0 Request processed in 234us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796791.411074:0:15985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:3.0:1788796791.414290:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.414348:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936306688 00000100:00100000:1.0:1788796791.414366:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936306688 00000100:00100000:1.0:1788796791.414427:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:1.0:1788796791.414438:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+17:14515:x1875688936306688:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788796791.415762:0:14372:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1788796791.415777:0:14372:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1788796791.416299:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936307072 00000100:00100000:2.0:1788796791.416307:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936307072 00000100:00100000:3.0:1788796791.417087:0:16601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:3.0:1788796791.417101:0:16601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd261308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+19:14514:x1875688936307072:12345-192.168.201.25@tcp:35:bash.0 00000001:00080000:3.0:1788796791.417410:0:16601:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000004:00080000:1.0:1788796791.417540:0:14373:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788796791.417671:0:16601:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:1.0:1788796791.417714:0:14373:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:3.0:1788796791.417875:0:16601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd261308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdf0c7da-3089-41ff-814e-0e93baa9b34e+23:14514:x1875688936307072:12345-192.168.201.25@tcp:35:bash.0 Request processed in 775us (3593us total) trans 8589934632 rc 0/0 00000100:00100000:3.0:1788796791.417883:0:16601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000020:00080000:3.0:1788796791.417889:0:16601:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788796791.419914:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23d58 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.419944:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23d58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.419958:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23d58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.419973:0:14373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23d58 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.419980:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23d58 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.420011:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23d58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.420032:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788796791.420146:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+22:14515:x1875688936306688:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 5707us (23756us total) trans 8589934633 rc 0/0 00000100:00100000:1.0:1788796791.420156:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000020:00080000:1.0:1788796791.420162:0:14373:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788796791.427982:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788796791.428000:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23d58 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.428012:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd14316a200 already unused, calling callback (ffffffffc14238b0) 00010000:00010000:3.0:1788796791.428017:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23d58 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.428028:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23d58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.428072:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bd24712b200) 00010000:00010000:3.0:1788796791.428075:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788796791.428081:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23d58 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.428088:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316a200/0xdd273c88cfe23d58 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.428108:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796791.428111:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788796791.428113:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796791.515946:0:16484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788796791.521850:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.521921:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936307328 00000100:00100000:1.0:1788796791.521934:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936307328 00000100:00100000:1.0:1788796791.521992:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:1.0:1788796791.522002:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd26130b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+22:14525:x1875688936307328:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788796791.522029:0:16253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788796791.522051:0:16253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23d5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x557a3bd94e65ee4f expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788796791.522145:0:16253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788796791.522283:0:16253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23d5f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee4f expref: 24 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.522297:0:16253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bd24712bc00) 00010000:00010000:1.0:1788796791.522300:0:16253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788796791.522305:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd14316b400/0xdd273c88cfe23d5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x557a3bd94e65ee4f expref: 24 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788796791.522318:0:16253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bd14316b400, rc 0) 00000100:00100000:1.0:1788796791.522380:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd26130b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdf0c7da-3089-41ff-814e-0e93baa9b34e+23:14525:x1875688936307328:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 379us (541us total) trans 8589934634 rc 301/301 00000100:00100000:1.0:1788796791.522400:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:0.0:1788796791.525156:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788796791.525298:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936307456 00000100:00100000:3.0:1788796791.525308:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936307456 00000100:00100000:3.0:1788796791.525364:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:3.0:1788796791.525373:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+23:14525:x1875688936307456:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:3.0:1788796791.525450:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d6d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.525466:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d6d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.525478:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d6d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.525492:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030400/0xdd273c88cfe23d74 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.525499:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030400/0xdd273c88cfe23d74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.525675:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030400/0xdd273c88cfe23d74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526037:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23d7b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526046:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23d7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526053:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23d7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788796791.526093:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23d7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526105:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d6d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526112:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d6d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526119:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d6d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526125:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031000 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796791.526129:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d6d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526136:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d6d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526147:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bd25296d000) 00010000:00010000:3.0:1788796791.526155:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796791.526160:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d6d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526167:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031000/0xdd273c88cfe23d6d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526179:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030400/0xdd273c88cfe23d74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526185:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030400/0xdd273c88cfe23d74 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526191:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030400/0xdd273c88cfe23d74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526196:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240030400 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796791.526199:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030400/0xdd273c88cfe23d74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526204:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030400/0xdd273c88cfe23d74 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526210:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bd24712ba00) 00010000:00010000:3.0:1788796791.526213:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796791.526215:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030400/0xdd273c88cfe23d74 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526220:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240030400/0xdd273c88cfe23d74 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526232:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23d7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526242:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23d7b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526248:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23d7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526252:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bd240031600 already unused, calling callback (ffffffffc1e804f0) 00010000:00010000:3.0:1788796791.526255:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23d7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526260:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23d7b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526267:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bd24712b000) 00010000:00010000:3.0:1788796791.526269:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788796791.526271:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23d7b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788796791.526277:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bd240031600/0xdd273c88cfe23d7b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788796791.526349:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+23:14525:x1875688936307456:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 976us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788796791.526356:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:0.0:1788796791.528843:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788796791.528943:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936307712 00000100:00100000:2.0:1788796791.528953:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936307712 00000100:00100000:2.0:1788796791.529006:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:2.0:1788796791.529016:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+23:14525:x1875688936307712:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788796791.529243:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+24:14525:x1875688936307712:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 227us (411us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788796791.529249:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:1.0:1788796791.693077:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.693129:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.693160:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.693196:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.693227:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.693252:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796791.693280:0:15985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936308096 00000100:00100000:1.0:1788796791.693292:0:15985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936308096 00000100:00100000:1.0:1788796791.693335:0:15985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936308352 00000100:00100000:1.0:1788796791.693339:0:15985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936308352 00000100:00100000:1.0:1788796791.693357:0:15985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936307968 00000100:00100000:1.0:1788796791.693359:0:15985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936307968 00000100:00100000:1.0:1788796791.693381:0:15985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936308480 00000100:00100000:1.0:1788796791.693384:0:15985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936308480 00000100:00100000:1.0:1788796791.693402:0:15985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788796791.693412:0:15985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+8:2358:x1875688936308096:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796791.693502:0:15985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+8:2358:x1875688936308096:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 91us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796791.693510:0:15985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788796791.693539:0:15985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:1.0:1788796791.693546:0:15985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebcda21d-22f8-459b-b210-3710c508852e+5:2358:x1875688936308352:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796791.693573:0:15985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebcda21d-22f8-459b-b210-3710c508852e+5:2358:x1875688936308352:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 27us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796791.693589:0:15985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:1.0:1788796791.693602:0:15985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:1.0:1788796791.693624:0:15985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+5:2358:x1875688936307968:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796791.693650:0:15985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdf0c7da-3089-41ff-814e-0e93baa9b34e+5:2358:x1875688936307968:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 28us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796791.693655:0:15985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:1.0:1788796791.693669:0:15985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:1.0:1788796791.693675:0:15985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebcda21d-22f8-459b-b210-3710c508852e+5:2358:x1875688936308480:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796791.693697:0:15985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ebcda21d-22f8-459b-b210-3710c508852e+5:2358:x1875688936308480:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 22us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796791.693703:0:15985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:2.0:1788796791.693782:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936307840 00000100:00100000:2.0:1788796791.693788:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936307840 00000100:00100000:1.0:1788796791.693804:0:15986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936308224 00000100:00100000:1.0:1788796791.693810:0:15986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936308224 00000100:00100000:2.0:1788796791.693818:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 123 00000100:00100000:2.0:1788796791.693827:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+13:2358:x1875688936307840:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796791.693851:0:15986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:2.0:1788796791.693856:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1166de96-7c57-41f7-a46b-7894de6a4a61+13:2358:x1875688936307840:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 29us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796791.693863:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 123 00000100:00100000:1.0:1788796791.693868:0:15986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd267307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebcda21d-22f8-459b-b210-3710c508852e+6:2358:x1875688936308224:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788796791.693909:0:15986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd267307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ebcda21d-22f8-459b-b210-3710c508852e+6:2358:x1875688936308224:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 49us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796791.693915:0:15986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00080000:0.0:1788796791.694860:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788796791.694877:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788796791.694880:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788796792.154177:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788796792.154210:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959356800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788796792.154307:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796792.154772:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959356800 00000100:00100000:1.0:1788796792.154782:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959356800 00000100:00100000:1.0:1788796792.154836:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788796792.154845:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959356800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788796792.154878:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796792.154949:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875688959356800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796792.154956:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788796792.155163:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875688959356800:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788796792.155189:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788796792.411923:0:14403:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788796792.411935:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788796792.411969:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788796792.411976:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788796792.537932:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788796792.669032:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3306:1875688959356928:0@lo:400:kworker.0 00000100:00100000:2.0:1788796792.669119:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796792.669168:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959357440:0@lo:400:kworker.0 00000100:00100000:2.0:1788796792.669196:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796792.669236:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788796792.669242:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959357056:0@lo:400:kworker.0 00000100:00100000:2.0:1788796792.669270:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796792.669306:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959357184:0@lo:400:kworker.0 00000100:00100000:2.0:1788796792.669334:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796792.669362:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788796792.669369:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959357312:0@lo:400:kworker.0 00000100:00100000:2.0:1788796792.669390:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788796792.669427:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959356928 00000100:00100000:2.0:1788796792.669436:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959356928 00000100:00100000:2.0:1788796792.669483:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788796792.669493:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd241327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:3306:x1875688959356928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796792.669544:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd241327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc080b8f-c449-46a7-a564-69e1c33bc9a6+19:3306:x1875688959356928:12345-0@lo:400:kworker.0 Request processed in 52us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796792.669551:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788796792.669602:0:15985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959357056 00000100:00100000:2.0:1788796792.669606:0:15985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959357056 00000100:00100000:2.0:1788796792.669635:0:15985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788796792.669642:0:15985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959357056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796792.669680:0:15985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1875688959357056:12345-0@lo:400:kworker.0 Request processed in 38us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796792.669687:0:15985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788796792.669706:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959357440 00000100:00100000:2.0:1788796792.669716:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959357440 00000100:00100000:2.0:1788796792.669788:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959357184 00000100:00100000:2.0:1788796792.669792:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959357184 00000100:00100000:2.0:1788796792.669810:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959357312 00000100:00100000:2.0:1788796792.669812:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959357312 00000100:00100000:2.0:1788796792.669832:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788796792.669838:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eadad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959357440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796792.669868:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eadad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875688959357440:12345-0@lo:400:kworker.0 Request processed in 30us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796792.669874:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788796792.669886:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788796792.669892:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ead8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959357184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796792.669929:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ead8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875688959357184:12345-0@lo:400:kworker.0 Request processed in 37us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796792.669934:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788796792.669947:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788796792.669953:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959357312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788796792.669978:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27eada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875688959357312:12345-0@lo:400:kworker.0 Request processed in 26us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788796792.669983:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788796792.670009:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788796792.670048:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875688959357312:0@lo:400:kworker.0 00000100:00100000:2.0:1788796792.670058:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875688959357184:0@lo:400:kworker.0 00000100:00100000:2.0:1788796792.670158:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875688959357056:0@lo:400:kworker.0 00000100:00100000:2.0:1788796792.670170:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27ead9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cc080b8f-c449-46a7-a564-69e1c33bc9a6:3306:1875688959356928:0@lo:400:kworker.0 00000100:00100000:2.0:1788796792.670195:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd27eadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875688959357440:0@lo:400:kworker.0 00000100:00100000:1.0:1788796792.671385:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9bd267307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959357568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788796792.671443:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788796792.671486:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688959357568 00000100:00100000:1.0:1788796792.671491:0:15057:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688959357568 00000100:00100000:1.0:1788796792.671528:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788796792.671536:0:15057:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27ecba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875688959357568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788796792.671579:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788796792.671624:0:15057:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27ecba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875688959357568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788796792.671631:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788796792.671674:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9bd267307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875688959357568:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788796792.774880:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:1.0:1788796792.774902:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:02000400:3.0:1788796793.224689:0:16639:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1788796793.566254:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788796794.592465:0:16484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788796794.769003:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788796794.769058:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788796794.769140:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936308608 00000100:00100000:1.0:1788796794.769152:0:15058:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936308608 00002000:00100000:1.0:1788796794.769215:0:15058:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff9bd27e378a80 x1875688936308608/t0(0) o4->fdf0c7da-3089-41ff-814e-0e93baa9b34e@192.168.201.25@tcp:220/0 lens 504/0 e 0 to 0 dl 1788796805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788796794.769226:0:15058:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd27e378a80 with x1875688936308608 ext(0->8) 00002000:00010000:1.0:1788796794.769232:0:15058:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd27e378a80 00000100:00100000:1.0:1788796794.769264:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:1.0:1788796794.769275:0:15058:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+6:2358:x1875688936308608:12345-192.168.201.25@tcp:4:bash.0 00000100:00100000:1.0:1788796794.769840:0:15058:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fdf0c7da-3089-41ff-814e-0e93baa9b34e+8:2358:x1875688936308608:12345-192.168.201.25@tcp:4:bash.0 Request processed in 565us (847us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788796794.769849:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00002000:00100000:1.0:1788796794.769856:0:15058:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff9bd27e378a80 x1875688936308608/t8589934598(0) o4->fdf0c7da-3089-41ff-814e-0e93baa9b34e@192.168.201.25@tcp:220/0 lens 504/448 e 0 to 0 dl 1788796805 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788796794.769878:0:15058:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9bd27e378a80 with x1875688936308608 ext(0->8) 00002000:00010000:1.0:1788796794.769882:0:15058:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9bd27e378a80 00000100:00080000:0.0:1788796794.770062:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788796794.770163:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875688936308736 00000100:00100000:3.0:1788796794.770171:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875688936308736 00000100:00100000:3.0:1788796794.770220:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:3.0:1788796794.770229:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9bd27e37a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+8:2358:x1875688936308736:12345-192.168.201.25@tcp:16:kworker.0 00000100:00100000:0.0:1788796794.855494:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9bd27e37a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdf0c7da-3089-41ff-814e-0e93baa9b34e+8:2358:x1875688936308736:12345-192.168.201.25@tcp:16:kworker.0 Request processed in 85252us (86423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788796794.855510:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000001:00080000:1.0:1788796794.855795:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed Debug log: 29764 lines, 29764 kept, 0 dropped, 0 bad.